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PREFACE 

The Deportment of Defense, like many other large organi/ations, 
pursues a policy of continual introspective examination in order to 
identity areas in which improvements can be made. Typically, these staff 
analyses are meaningful and of interest only to selected managers within 
the Department. On occasion, however, the topic is of such general in¬ 
terest to other branches or agencies of government, or to the public at 
large, that wider dissemination of the report on the analysis appears 
warranted. This final report on Project HINDSIGHT is considered as 
falling into the latter category; in fact, an earlier interim report on 
HINDSIGHT received wide distribution. 

The reader must appreciate that this report covers only a small 
segment of a much larger area of interest in the dynamics of R£D manage¬ 
ment. The object of this preface is to emphasize that the Project HIND¬ 
SIGHT study had certain clearly recognized limitations. 

The approach taken In Project HINDSIGHT was essentially retrospec¬ 
tive. Twenty recent weapon systems and major mi litary equipments were 
analyzed by teams of technical specialists to identify applications of 
science and technology that were not utilized in predecessor military 
systems designed to meet roughly the same requirements. The evolution 
of the new technology represented In each system was traced back in time 
to critical points called "research or exploratory development (RXD) 
Events." The RXD Event is the basic quantifying unit in the study, and 
is defined as the occurrence of a novel idea and the subsequent scien¬ 
tific and engineering activity in which the idea Is examined or tested. 
There could be one or two RXD Events, or an extended chain of them, 
culminating in a device or component found in a particular system. 

The teams of specialists identified 710 unique RXD Events, conducted 
the historical traces, and described and documented the related activi¬ 
ties in terms of the differential amount of knowledge that accounts In 
part for the increased cost-effectiveness of the systems analyzed, com¬ 
pared with their predecessors. These 710 RXD Events represent only a 
portion of the events that might have been identified by a more exhaus¬ 
tive analysis. To Illustrate the gross limits of the study, Project 
HINDSIGHT concentrated only on the post World War II contributions of 
science and technology to the selected systems. Each study team was al¬ 
lowed about three months to complete its research on each system. 

In treating the sciences, HINDSIGHT distinguished (I) the basic 
research done to solve a specific assigned problem from (2) the basic 
research done to expand the frontiers of scientific knowledge; these 
were categorized as directed and undirected basic research, respectively. 
It was found that RXD Events from the directed basic research category 
emerged In systems development approximately nine years following their 
conception, while it took 20 or more years for some events from the 
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p Luis ib If basis upon which .1 judgment . ol th.rl kind might h>' made • 

Project HINDSIGHT has providt-il data showing that, hiootlly >. waking, 
the DoD's requirements are being iullillfd by the results ol Di-I.mi.i- 
suppbrted research and development programs. During the Iy66- HIND¬ 
SIGHT time frame,, in which 96 percent of the idem i find KXD Events 
occurred, the DuD spent about $10 billion in support of science and 
technology. Also during this period, industry and other Federal agen¬ 
cies spent about $6 billion in the same areas. It might be expected, 
then, that about. 60 percent of DoD-uti 1 i/od science arid technology would 
come from these-other sources. In fact, Project HINDSIliH'l found that 
95 percent of DoD-utiIized knowledge came Trom scientific and technolog¬ 
ical activities supported either directly or indirectly by the Department 
of Defense. The DoD will therefore continue to ask for the necessary 
resources to fund and manage broad research and development programs 
that are responsive to our short- and long-term needs for weapon systems. 

Some results of Project HINDSIGHT suggested that the interaction of 
scientific and technological knowledge is stimulated by, and is most 
productive for, weapon-system development in a problem-oriented environ¬ 
ment. The dynamics and causal relationships between the researcher in 
the basic sciences and the applied scientist or the technologist are not, 
of course, completely understood or defined. However, the HINDSIGHT data 
Indicate that 61 percent of the RXD Events identified had a specific 
systems requirement as an objective and that over 85 percent of the tech¬ 
nological events occurred after a problem applications group originally 
defined the problem to be solved. This finding seems to support the 
hypothesis that the rate of transfer and utilization of scientific and 
technical knowledge may well be increased when a specific goal or system 
problem provides the impetus. 

The Department of Defense recognizes clearly that the HINDSIGHT 
project has net studied, in any comprehensive way, the influence of sci¬ 
ence on the development of technology. There are findings here which 
demonstrate that the basic research community clearly contributes to 
systems development—for example, through the fundamental process of ed¬ 
ucating those who become the inventors and users—but the study did net 
examine the role of basic science. The HINDSIGHT report and other sub¬ 
sequent analyses of the interaction between science and technology have 
not altered the strong philosophical commitment of the DoD to aiT-aggres- 
sive, high-quality program of research in the basic sciences. Such a 
program is critically important to our future national security. 
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■ I mini VI SUMMARY 


Projoci IllKlOSIGIil was cstulil i^hcil l.y ,tliu Oii u< f.,i ol Deluuse Re¬ 
search and engineering in his memorandum of 6 July Ii#6f» t cj tin: Assisi am 
Secretaries (Research and Duvt* I opulent) of tile. Mi I i lory Department s . 

(See Appendix A.) . 

Obje ctives a mi St rategy. 

The defined object ives of Project HfNDSIGHT were: 

(a) To identify those management factors that are important 
in assuring that research and technology programs will be productive and 
that program results will be utilized; and 

(b) To measure the overall increase in cost-effectiveness in 
the current generation of weapon systems compared to that of their 
predecessors (when such can be identified) that is assignable to any 
part of the DoD's investment in research in science and technology. 

The strategy adopted to achieve these objectives involved: 

(1) Determining the extent to which new weapon systems are 
actually dependent upon the results of recent advances in science or 
technology for their attained increase in system effectiveness, decrease 
in cost, or Increase In cost-effectiveness as compared to a predecessor 
system. - .. >' ;• '■ .. /'.. 

! ■ (2) Determining the proportion of any new technology, required 

for attaining system characteristics, that was the result of DoD-financed 
research in science or technology. 

(3) Determining significant management and other environmental 
factors, as seen by the research scientist.or engineer, that appear to be 
commensurate with high utilization of research results. 

(4) If the findings of the first strategy indicate a signifi¬ 
cant reliance on new science or technology, devising a value-cost index 
(or set of indices) which offers a quantitative measure of the return on 
investment in research; in terms of the enhanced cost-effectiveness of 
the weapon systems made possible by the purchased knowledge. 

The study efforts were organized to offer, in a comparatively brief 
period of time, the class of information that could be of primary use to 
senior management levels of the DoD and the military services. These 
objectives have been achieved. This report describes the findings,and, 
where appropriate, suggests their implications. More detailed informa¬ 
tion which—a I though it might have some policy implications —is of 
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givuler interest to the lower management echelons wilhitt the sclent if it 
anil teclmoiiniic.il communities will he developed Inter. 

The study personnel consisted ol llie* following: 

Ad hoc t earns of military and civilian in-house (DoD) persormc I; 

Consultive and participating contract support by behavioral 
and managemei t scientists from Northwestern University and the Sloan 
School, Massachusetts Institute of Technology; 

Contract support by econometrics scientists from the institute 
for Defense Analyses (IDA) and the Rand Corporation; and 

Voluntary participating support from five Industrial-management 
scientists. 

The in-house teams were concerned with establishing trie amount of 
new science or technology embodied in modern weapon systems, ascertaining 
the financial support for this science or technology, and defining gross 
management patterns. The uni versity and Industrial-management scientists 
are concerned with the more subtle aspects of research management* In¬ 
cluding idea flow, information sources, training, individual effectiveness 
and motivation. IDA and RAND are attempting to devise credible $nd use¬ 
ful value-cost indices for research. 

Methodology 

Each ih-housetearn focused on a single weapon system. The subsys¬ 
tems, components, materials and enabling system concepts were examined 
in detaiI for evidence of the application of knowledge resulting from 
recent research in science or technology. Subsequent to the recognition 
of this evidence, 'each team undertook an investigation to ascertain the 
source of the riew knowledge and the circumstances under which the knowl¬ 
edge was generated and passed to the eventual user. 

The basic element for quantification within Project HINDSIGHT is 
the Research or Exploratory Development (RXDj Event. The RXD Event de¬ 
fines a scientific or engineering activity during a relatively brief 
period of time that includes the conception of an idea and the initial 
demonstration of its feasibi1ity. There may be one or two RXD Events, 
or an extended chain of them, culminating in a device or component found 
in the studied weapon system. The final fabrication of this component 
or device may or may not involve an Event, depending upon the state of 
the technological art at the time of fabrication. 

Many observations derived from the analysis of Project HINDSIGHT 
data confirm widely held assumptions of successful research managers, 
and in these cases the primary contribution of the Project is to make 
available quantifiable support for what previously had been informed 
opinion. There were," however, some significant findings wherein the 




il.it j contradict 'sortie qeiiei'.i 11 y tie lit be I iefs. The lot lowing par ;igrdplis 
contain .1 summary of the findings, based upon analysis ol. thi* current iy 
avai I able data, and sonic interpretation' of those findings. 

It is emphasized that this "study ident i f-i'ed on ly those iiic reiiKj n l <j i 
contribut i'jns to existing bodies oT sciunli l ie and ..technological knowl¬ 
edge that were utilized in the analyzed military equipments. The strong 
dependence of these contribution upon the total base of science.and 
technology must be recognized.. The reader is cautioned that any conclu¬ 
sions regarding the Value of the total knowledge base cannot be validly 
drawn front the findings presented here. 

HINDSIGHT Findings 

(1) Tho iaontifioalion of specific evcnlr, in science or technology 
I'ch.ViijW.*, the results of which were utilised in,and were critical to, 
new weapon si/iibane, mr. fount to-be fairly simple. 

For most of the systems studied, on the order of 100 to 150 post- 
1945 contributions from the scientific and technological communities 
were uncovered. Practical limitations in time and resources, however, 
permitted only a smaller number to be examined in detail. In no case 
did the study team feel that it had exhausted the possibilities for iden¬ 
tify i rig additional contributions. Studies of the individual systems 
were terminated when the study team and the Project Director were quite 
certain that a representative sample of the contributing Events had been 
investigated or a 3-month study period had elapsed, whichever came la¬ 
ter. Estimates of sample size, made at the completion of the system 
study, varied from 20 percent for the 0-141 cargo aircraft to 75 percent 
for the LANCE missile system and over 95 percent for the Mark 56-and 57 
Naval mines. 

(2) The number of Events that were easily identified varied pro¬ 
portionately with the relative increase in effectiveness between the 
studied System and its predecessor. • 

For example, the studies quantitatively demonstrate that more new 
technology was required to progress from the HONEST JOHN rocket to the 
LANCE missile system than from MINUTEMAN I to M1NUTEMAN 11. 

(S) Do category of performing agency was found to be significantly 
more efficient in the production of utilized research results than other 
■ categories. 

The distribution of identified RX0 Events that came from universi¬ 
ties, industry, or the in-house laboratories of the Military Departments 
agrees, to within a very few percentage pointswith the allocation of 
applied research funds to these categories. 
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Although the profitable work) reguent ly wes t l.issi! ioblc .is applied 
research, in that the scientist was attempt i tig to resolve a veiy specific, 
problem, it does not appear.that specific appliedlion per sv is u suffi¬ 
cient criterion for predicting usages. Perhaps the most important factors 
in establishing a high probability of utilization are the degree of 
awareness (a) oh the part of this scientist concerning who in the engi¬ 
neering community needs the knowledge and (b) on the part of the inter¬ 
ested engineers as to which specific scientist is working on the problem. 
Accordingly, research managers must be sensitive to the need for commu¬ 
nication between the scientific and engineering cotmnuntties. 

Four sets of scientific Events that assume great importance because 
of the number of systems that rely upon them are readily distinguishable. 
They include work that led to information and filter theory, inertial 
guidance components, rocket engines and propellants, and transistor tech¬ 
nology with its associated miniature passive electronic elements. In 
each case the preponderance of the research effort was independent of any 
specific weapon>-system development, but was found to have been guided by 
individuals who were acutely aware of the detailed problems confronting 
design engineers and of the limits imposed on achievable system perform¬ 
ance by available pertinent technology. 

(5) A significant number of important eeuntifie contributions came 
fvot'i sources otiier than contemporarily recognized experts. 

Investigation of a sampling of these Events disclosed a fairly com¬ 
mon pattern. The performers of the utilized scientific effort and their 
peers were mutually aware of the exploration each was undertaking, but 
there was marked disagreement regarding the merit of the approach that 
eventually found use. in each case the successful performer broke from 
the peer group, moved away, and found new funding. More than anything 
else, these examples point out the necessity for ensuring competition 
within bureaucracy and the necessity for maintaining a multiplicity of 
funding sources for every scientific discipline and area of technology. 

When high payoff from scientific research at universities was iden¬ 
tified, the Scientific research was coupled closely to research in tech¬ 
nology and some limited development. Typical examples are the inertial 
guidance theory and component work at the Instrumentation Laboratory, 

MIT, and the propellant research at the Jet Propulsion Laboratory, 
California Institute of Technology. 

Within this report, tmdireeled basic research in science, as de¬ 
fined in Table 111 (page \k) , refers to tasks not clearly identifiable 
as part of a larger program that was coordinated by a mission-oriented 
agency. In general, they are those individual, comparatively small ef¬ 
forts undertaken by one or two investigators in the universities, in 
>'isv not-for-profit corporations and, to a much smaller extent, in oth»-- 
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industry.'' they o i «* chut .n'lcriVi-il by l lie fuel Hut Huy van- myt iv.tud 
.it liu- i vSc.irchel 1 •> level by sc'ient Hie curiosity and sciiol.it ly inquiiy, 
.ind wi'i'i 1 supported by tlie Dol) upon recdyiVi l ion of tin- i dev.ince and siy- 
n i t iiuiu-e ol the r.eseuri.lier 1 s proposal. 


/tn important payoff I’rom scientific research at univursi t ie% lias 
been through the schooled seient i sis and engineers who later performed 
the applied research. Of the 1,795 individuals identified as having 
coni it bitted to an RXD Event , detailed information is currently available 
on 511. of whom 92 percent hold academic degrees in science or engineer¬ 
ing. The obscM vat ion that the practicing engineer tends I h depend large¬ 
ly upon unified theory\(e.g., Kepler's, Newt.mi's and Boyles' laws and 
Maxwell's equations) suggests that a major payoff of undirected basic 
research is through knowledge acquired during undergraduate education. 


During FY 1965, based on a percentage breakout of research and 
development funds, approximately 26 percent of the nat ion*s sclent i fic 
and engineering talent was employed directly or indirectly by the 
Depai uient_ of Defense. This f igure has remained fai rly constant over 
the past several years; . As a major user of these resources, the DoD 
should have a selfish interest in ensuring the continued supply of tal¬ 
ent by guiding potential abiIity into scientific disciplines or techni- 
cal areas of marked military relevance. The selective use of research 
grants and contracts is one way of affording such guidance. 


Complementing this knowledge accrued through formal education is 
the engineer's later recourse to codified or tabulated information, such 
as engineering handbooks and technical references. The second payoff of 
basic scientific research is identified as the organization of research 
results into a format readily available for general yse. In this way, 
new concepts of everything from materials characteristics to design 
techniques have been widely disseminated. Management criteria intended 
to enhance the usefulness of research results should include recognition 
of the importance of unifying or codifying information and the require¬ 
ment that the objectives of supported research be so oriented. Periodic 
surveys Should : be made, and research advances in particular subject areas 
should be consolidated and published in a format designed for use by 
engineers. • 


,'f'V .The. greatest payoff interms of ideas leading to enhanced 
weapon syotems has resulted from research in teclmologit—ccnd Hick, ::iuvc 
t'm research scientist, or angijieer me Ultimately amre of problems of 
the applications, engineer. 


The transfer of science to technology and technology to application 
has been found to rely heavily on personal contact between individuals 
(see Table VI, page 1(7). The communication link is of critical impor¬ 
tance, both for advising the scientific community about leal problem 
areas and for disseminating scientific or technological knowledge to the 
eventual user, the applications engineer. 










Hu* 10.11 ili I I cli'iu i* in )n-i I'm iiuiiu i' ln-twovn .1 w>'.i|jimi •.y.lrlu .iIh! i I *, 

. predecessor i s usu.i I I y nut the innsequeiKt* «»l one, two hi thtee *,< ionl il it 
advances nr technological capabiIities hut i>, lIn- syiienjisrii Vllei.l ol 
100 , 200 nr 100 advances, e.KIt of wlVir.l» ,1 lom* is 1 el.il iv«*ly insiqiii fir.,in . 
Those hundreds of diverse advances most then ho f i t loti .mil nil jus tod lot 
.1 unified njior.it ional, weapon systoni. The charm tori sties ul ouch advance 
must be carefully "interlaced” wi III l host: (if other advance.. llii*. is 
sub stunt i at oil by Project HINDSIGHT data, which generally shut.- that sys¬ 
tems uppl icot inns, rather than now science,. Inspire ■sviemr atitl let Into It 
tujy for advanced systems. 

•* M ■! .V>::'/tW\l/*/e *«*«».'/' .1/ tf.-fci f, / f.r !•» 

.‘;svA 

Analysis of the time relationship of on RXD Evuni's occurrence to 
its utilization in the studied system reveals two characteristic patterns. 
Where the - weapon-system development progressed directly from 0 technolog¬ 
ical base (exploratory development) to engineering development, there is 
a marked peaking of Events about the time development is initiated, with 
about 4i percent for-LANCE and 60 percent for MINUTEMAN it occurring 
after development had started. This situation appears to be Incompatible 
with current procurement policies that stress fixed-price development 
contracts (with or without Incentive fee). Where the weapon system pro¬ 
gressed from a technological base tnrough an advanced-development phase 
and then Into engineering development, a much more uniform distribution, 
devoid of significant peaks, is noted; examples are the Hark 56 and 57 
Naval mines. 

Project HINDSIGHT did not investigate system-management aspects of 
the weapon systems studied. It is understood, however, that in at least 
three cases—the BULLPUP air-to-surface missile, the C-141 cargo aircraf t 
and the LANGE missile system—development was undertaken after assurance 
was given that the requisite scientific and technological knowledge was 
in hand. The Event-distribution charts adequately demonstrate that these 
assurances were not valid. A major reason for the lack of validity be¬ 
comes apparent in a study of the detailed Event descript ons. At the 
time an advanced weapon system Is proposed, the design engineer forms 
his judgments on the basis of experience or the extrapolation of that 
experience—the more advanced the proposed system, the greater the de¬ 
pendence upon extrapolation. A requirement for research in technology 
arises when the extrapolation proves to have been overly optimistic. 

In view of the potential economic advantages of fixed-price system- 
development contracts, the matter becomes one of determining how, in 
the light of Project HINDSIGHT findings, it is possible to ensure that 
such a contractual situation can be meaningfully established without 
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Mil* Mark !>6 anti *>/ N.iv.il mini". , di'velcipi'd in on Vnv i rouinriit lli.il 
cunviil ly would ho con^idi-rod oilvoin.oit ilovi'lopincnl (K).L) col i-guiy '■ '(>.'}), • 
iloim>H>ti o«o wlioi coil ho ilitno. . Hu- npp.ni'iit r.ilo iit whic h technology 
wos iilli.nlnooil shows (ho orderly progress that is possible throughout 
do vo I npinoMi in tho oh son go of 0 product'inn tommi Imont or ;ur overly 
omlii lions doJ ivory schedule. Hie invest icpil ion disclosed that, during 
the early development years, the work was accomplished at 'an essentially 
oons taut level of effort. Fixed .sums of money were mode available for 
investiyations into problem areas that were disclosed as the system's 
desiyii took shape. Production did not start until a prototype deffiorr 
stKit ing that the probleius had been reduced was esscnt ial ly complete. 
These examples suggest that the greater use of prototype-system devel¬ 
opment in the advanced-development category, to provide focus and spur 
to research in science and technology, can be a successful prelude to 
fixed-price production contracting and still ensure a significant in¬ 
crease in operational performance. 

(10) ViniHlitii of tvm.mHth trxpciditurets nan bn retain..; h* meant: 
of buiiei i\t Uy(miqitco. V; 

Alternatively, fixed-price development contracting might be made 
feasible by assigning to the Government project manager a degree of 
control over a portion of the Military Department's technology money 
(R&D categories 6.1, 6.2 and 6.3) in addition to the engineering-deveI - 
opment (6.4) money committed to the contractor. This would, al low the 
project manager to influence the development of the necessary technology 
for his system, ensure that the technology money was in fact directed 
into areas of established military importance, and by keeping the fund 
in the 6.1, 6.2 or 6.3 categories give visibility to expenditures. It 
is clear that the use of this technology money must remain responsive 
to the control of the Government project manager to be parceled out as 
needed. Obviously, great care must be taken to ensure that these funds 
don't become a "bail-out" resource to cover nontechnical management 
deficiencies. Examples of the successful application of this approach 
were found in the development of the Mark 46 torpedo and the AN/SPS-48 
radar. 

( Jl) The Do!) han required a eonsiJerable { amount of nev teeimqlo.ji- 
u>dIktuheul to fund moot of it. 

The relative ease with which RXD Events contributing to the capa¬ 
bilities of new weapon systems were identified, the number and diversity 
of those Evenls, and the recognition that the same level of the utilized 
science or technology almost never existed at the time of engineering 
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It is estimated the Kilitaiy Depart lik'd t*. spent about §10 hi 11 ion 
during 1945-1963'"wheh must of the ident i l ied t vent s occurred (see Appen 
dix F), For the same years, another estimate places .expenditures lur- 
research In science and technology by industry and other non-Offense 
sectors of tlie economy at approximately $7 hi 11 ion. the f inding that 
the acquisition of 85 percent of the' utilized new scientific and techno¬ 
logical information was financed by the Mi l itary Departments becomes- 
significant in view of the relative size of the two amounts expended. 

We may conclude from these two observations that a great deal of 
new knowledge was required for on advanced weapon system and the De¬ 
partment of Defense could not rely on other sectors of the economy to 
generate it. This conclusion is strengthened by the finding that, of 
the remaining 17 |>ercent not directly funded by the ftoD, 9 percent was 
paid for by defense-oriented industries and was thus indirectly funded 
by income from previous Defense contracts. 


(It'i Tmnsfovof technological information is at a 
;ivf w it-fiin the defense-oriented aimimii-y. 


vv.isonahly high 


Approximately 300 separate organizations or corporations have been 
identified as having contributed to the fund of new knowledge. About 20 
of them had significant responsibi1ity as prime contractors in the devel¬ 
opment of one or two of the studied systems. Despite the great number of 
participants, over 80 percent of the RXD Events (but an estimated 20 per¬ 
cent within the set of systems studied) are known to have found applica¬ 
tion in more than one weapon system. At the very least, therefore, it 
can be claimed there are strong indications that information transfer 
within the defense engineering community is at a usefully high level. 

The Project HINDSIGHT study did not attempt explicitly to identify 
alternative technologies used in the several systems where one of the 
alternatives theoretically might have satisfied all users. The number 
Of cases involving such a situation was so small as to appear statisti¬ 
cally insignificant. 

(IS) The performance of the in-house DoD laboratories appeal's to 
be consistent with the numerical strength of their professional personnel. 

After the sources of the utilized new science and technology were 
identified, it was possible to examine time-dependent trends in terms of 
the relative productivity of the various sources. As far as new science 
is concerned, the available data are not statistically significant. A 
marked trend, however, is observable with respect to technological activ¬ 
ity. farly in the 1945-1958 period, about 51 percent of the new technol¬ 
ogy was coming from the in-house laboratories of the Military Depart¬ 
ments, with 42 percent from indusLry and ~j percent from the universities. 






By HVJ Hk- b.ilvini.1' wu*> .reversed, so llun Jb pt'imu w.i', coming ! n.iii the 
DeI imWi* Inboratix ios , percent I rimi indusi t y , and 6 percent I t om The 
univt'i si l ies (|rrim,iri ly imivtiisi ly-opcroli'cl centers such <i\ the KesisfrUi 
Laboratory lor tier Ironies or tin* Inst rumemat ioii laboratory ,u HIT). 

During this whole l inn*;' the scientific and iriigi nveri ng strength of 
the non-BoD community essential 1y quadrupled, while Thu s(rength of tin- 
in-house Defense laboratories less than doubled. Thus, the -change* in 
re lot i ve output appears to reflect only t he re I at i vv increase in si rengtli. 

. Findings Pertinent to Strategies Used 

lit terms of the four strategies employed to attain the primary ob¬ 
jectives of Project HINDSIGHT, the relevant findings are summarized here. 

Strategy 1 : Determine the extent to which new weapon 
systems are actually dependent upon the results of 
tVi-vM.f adfaineco In science or technology for their 
attained increase in system effectiveness, decrease in 
cost, or increase in cost-effectiveness as compared to 
a predecessor system. 

Findings :. Markedly Improved weapon systems result from skillfully 
combining a considerable number of scientific and technological advances. 

There is a high positive correlation between the relative 
sophistication of the predecessor and successor.systems—or the relative 
increase in their effectiveness—and the amount of new science or new 
technology utilized in the successor. 

Strategy 2 : Determine the proportion of any new 
technology, required for attaining system charac¬ 
teristics, that was the result of DoD-financed 
research in science or technology. 

Finding : More than 85 percent of the new science or technology 
utilized in weapon systems was the result of DoD-financed programs. 

Strategy 3 : Determine significant management and 
other environmental factors, as seen by the research 
scientist or engineer, that appear to be commensurate 
with high utilization of research results. 

Findings : The utilization factor appears insensitive to classical 
differences in organizational structure or profit motivation appearing 
between U.S. industry, in-house DoD laboratories, and university-associ¬ 
ated science and technology centers, it may, however, be sensitive to 
differences between these types of organization and the classic organi¬ 
zational structure of universities, 





]lu* must use 1111 role nl stieiice fi.e, yeii.r,il ly U-.u 
of providing plienomeno logic,* I explanations to the eli<| iiu-irr. 

rite engineer uses unified scientific I henry ,nul cndifieil 
scientific intonikit ion. 

The .program of leveurch in technology or ienu-d toward 
specific types of equipment has been a part i till ally successful approach 
to generating ul i I iieil knowledge. 

Achievement of a high combi ned inventivuncss, or in¬ 
genuity, and utilization rate are dependent upon the time and space 
coexistence of four primary factors—the recognition of need, a source 
of ideas in the form of an educated talent pool, capital resources, and 
an adequate communication path to potential users. 

Stra i *gy h: If the findings of*the first strategy 
indi» U a significant reliance on new science or 
technology, devise a vaiue-cosf index (or Set of 
indices) which Offers a quantitative measure of the 
return on investment in research, in terms of the 
enhanced cost-effectiveness of the weapon Systems 
made possible by the purchased knowledge. [This 
objective has not yet been satisfied. Relevant 
findings serve primarily to define the problem 
further.] 

Findings*• A number of .factors identified through tlie studies made 
thus far tend to refute the possibility that any simple or linear rela¬ 
tionship exists between cost of research and value received. They in¬ 
clude the following: 

(a) There is a high probability that any given scientific or 
technological advance, if used In one system, will be used in many other 
systems. Thus, any cost-value index must either apportion the research 
cost among all utilizing systems or attribute a portion of the total 
value added by each utilizing system to the identified RXO Event. 

(b) Improved weapon systems or end-item equipments tend to be 
a synergistic rather than cumulative consequence of the several embodied 
scientific and technological advances. Thus the task of apportioning 
value added becomes complex. 

(c) The relative amount of new scientific or technological 
knowledge required to achieve greater effectiveness, lower cost or im¬ 
proved cost-effectiveness of a new system, as compared to that of a 
predecessor system, increases with the latter's technical complexity. 
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11ms, ,iny i iiiiIi’ .ippuixim.il ion iii im-.isui in(| v.ilia- .iiliK-il .is ,i i 
nl ivsisii'ili expend i I iiivs wi I I' trial to In 1 deluvny in lli.il ie| 
i lives; nil’ll l will always .ippi-.n qiv.ilct will’ll -in impi uvi-menl is 
s imp lr sysU’iil. 


As’ .1 I ino.] noli 1 , two iii.U let s must Ijc emphasized. 

First, the scope of l h is st uily unci its resultant lihdiugs are ton- 
coined'only with the acquisi t ioii of know I edge 'jssent ial to the techno' 
logical ileve I opulent of a weapon system. Quest ions concerning the use or 
value'of. the results of research in the behavioral, life environmental 
or social -sciences were not addressed. 

•Second, none of the findings described above should be interpreted 
as a disavowal of the value of very fundamental research in science. It 
is .hard ly -fikely that the transistor could'have been invented .by people 
who sought a smaller'; more rugged electronic signal amplifier but "were’ 
unversed in Wave mechanics or the theory of electrons in solids; that a 
search for new power sources would have led to the nucleus of the atom 
in the absence of the work of Curie, Fermi and others; or that radio or 
telephone communications could have been invented without the research 
efforts of Hertz, Maxwell, Marconi and their fellows. 

The findings suggest only that defense research is most likely to 
culminate In utilization when deliberate attempts are made to relate the 
research results to the problems of the mi 1itary services. 









I. INTRODUCTION 

PiojVil HINDSIGHT is ,1 historical survey of Hie process by wliit.h 
model n weapon systtws «ind current operational procedures acquire their 
scientific oiid lechiK.l09ic.il bases, Hie studies ore focused on: 

(1) the people who can he identified as having played signif¬ 
icant roles in the acquisition of this knowledge, the management environ¬ 
ments iq which they worked, and the behavioral patteins they exhibit; 

(2) analysis of the ut i I i.zcd technology , time distributions 
between o discovery or invention and its application, uniqueness in 
terms of areas of practical application, sources, interaction between 
the recognition of requirements and the generation of new knowledge; arid 

(3) econometric investigations of research in science arid 
technology, estimates of the value-cost ratio of this research, and de¬ 
velopment of new analytical tools to provide management measures of the 
effectiveness of research. 

The lime frame of primary interest in the study is the period from 
19^5 to the present. 

The history of military support of research In science and technol¬ 
ogy in the United States dates back almost to the time of the organiza¬ 
tion of the military services. Although the resources available for 
commitment to these activities undoubtedly fluctuated with national pros¬ 
perity, congressional or executive moods and specific exigencies of the 
services, a number of factors combined to minimize inherent difficulties 
in the management of whatever research programs existed prior to I9*t0: 

First, until the latter part of the 1930s, the lack of mili¬ 
tary interest In recognized scientific opportunities limited the number 
and scope of potential investigations. 

Second, the research potential of the nation resided primarily 
in its universities, and communication channels between the academic 
and military communities were practically nonexistent. 

Third, the total funds available, either in terms relative, to 
current annual expenditures for research or in terms relative to contem¬ 
porary defense budgets, were so small that their management constituted 
no problem. 

Fourth, the contemporary practice of supporting research out 
of the development program for which the knowledge was desired afforded 
a level of coupling, or visibility, that minimized any requirement f. 11 
separate justification. 











Si .11 t i ot | .ilioul I‘j4l), -.cvt-i.il I *« U« \ i tiiiili i iiftl u, i.itr.r (•/•.tensive 

,fuiu|e-. in tiu- (Iclense le-.e.irdl eliv i r onmen l . t uml.iihen 1.11 ilis.fiVei it', 
in the -.(ieiKes, p.n t it ul.ir ly in qu.inlum pliy.it 1 ., e It-. 11 tiiii ( s niul clvm- 
isiry, bail •> iqn i I i t .nit I y iiicfV.r.ed iippor I uni 1 it-. Inr (lelfie.e ui it-nlctl 
ieso.in.il. I ho high level nl support given lo re-.t-.uth tltn intj Win Id W.n 
II nut only resulted in the prol i fer.it inn of scieniists witliin anil out¬ 
side tin* univorsi t ies, jjtil. in titltli lion treoled ciiinmiuiL.it ion c lij.inie I •- 
between the sc i on Vi sit s .linl the inililaiy. 

Tht- potoiiii.il .lppl i td l ion of new knowledge .it. loss .1 multiplicity ol 
.Klv.mced weapon systems and the increasing costs of research comliiiied to 
introduce .1 concept of research supported separately from specific weap¬ 
ons or weapon systems. A11 unstable post World War II political environ¬ 
ment encouraged an iterative process of acquiring and using'new knowledge 
leading to advanced weapon systems*, which in turn eslabl i shod requirement!, 
for more knowledge' to enable more advanced defensive or counteroffensive 
weapons. This provided the justification for a steadily increasing level 
of expenditure for research. 

Between 1945 and 1963 an estimated $10 billion was spent by the 
Mi I itary Departments for research in science and technology. InTY 1966 
alone, $1.4 billion was programed for this endeavor. In both relative 
and absolute terms, the rate of expenditure had grown to the point at 
which searching questions by "Management" were inevitabie and cssenLial. 

Project HINDSIGHT was established in order to determine analytical ly— 

f the importance of research in science and technology to the 
Department of Defense; 

... the uniqueness of Defense requIrements for research, if any; 

,, management factors that significantly influence the produc¬ 
tivity of research; and . 

© answers to many of the other questions that have been raised 
by conscientious administrators. 

Specific questions have been as varied as the background and inter¬ 
ests of the individuals posing them. However, most of the questions—or, 
more precisely, challenges to the continued Support of research—may be 
fitted into one or more classes. Some of the primary orientations are 

suggested below. Each is presented in the forth of a hypothesis to afford 1 

guidance in terms of pertinence of information. 

• The Department of Defense's requirements for .information in 
science and technology can be satisfied to such an 'extent by research 
supported by the National Aeronautics and Space Administration arid the 
National Science Foundation that significant reductions can be made in 
the applicable portions of the Defense budget. 
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e lln- i in ran! I y liiqh-lfvi'l. l ul basic woi k i >, pr mint i nij 

si iant i tit .iiul. tin liiiii.il inluinnilioii >ii •iiiiir.ii.itflh.il it ( .tmitit In- 
of I eel i H' f-> ili.|e-»leit, iiiteipieteil, il!..«,eiiiiii.ited, o« put to pr.st lieu I use. 

• Pfp.it t ineiit uf Del eitse liKin.ipfiiifiituI Ifiisiri li in si ieui.e .mil 
. .hneluqy, in niilyr to be lully el let live, must iikike tutiip.iriit ivy tfist- 
ofloci ivoiifss .111,1 1 ysos tor. each separately iilenl i i i.ibli* reseui tti efloit, 

• Sttinific.ini portions uf the Oelense research prop rum nwy lie 
opfi.it inn .it iir near .» point of mnrgin.il returns, 

• The support of scientific research in the universities', by 
the Department of Defense ami at current funding levels, significantly 
affects the av.tilabiI $ly of the best faculty'talent'to teach students. 

The requirement for judgment criteria, implicit in each of these 
hypotheses, suggests that an analysis of the historical use of research- 
generated knowledge cannot alone provide fully satisfactory proof or 
refutation. Project HINDSIGHT recognizes this situation and adopts some 
augmenting hypotheses, the test of which will offer further evidence for 
or against the previous set, and also will provide some guidance to man¬ 
agement where the findings are less than satisfactory. The supplemental 
set concerns itself with management factors affecting the use of research 
results. The concept implicit In this approach is based on the argument 
that, if the management factors encouraging the use of research can be 
identified, current management practices can.be comparatively analyzed 
and modified, where and if necessary. The general themes of the propo¬ 
sitions tested in the supplemental hypotheses include the following: 

Criteria— The strategies used by individuals and groups in the 
selection of research tasks whose results were utilized. 

Control— -The nature of the control environment within which 
successful groups work; the degree of freedom of choice and action by 
the various levels vis-H-vis their superiors and the larger environment; 
the degree and nature pf authority over fiscal and technical matters at 
the various levels. 

Ski11s —The way in which new scientific and technical skills 
are developed; the role the skills play In accomplishing utilized re¬ 
search; factors influencing the cost and time of moving into a new field: 
the use and effectiveness of retraining and continued graduate studies. 

Interface— Relations between the successfully performing re¬ 
search group and organizations involved in other phases of the RDTSE 
(research, development, test and evaluation) cycle; the significance of 
communications lag and distortion; the value of liaison individuals. 

I ilea f1ow— Condi11 ons in the immediate (group) and larger 
(organization) environments that influence the kind, number, source, 
communication and disposition of ideas for new investigations. 
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Ust* of i ill orni j t io n--1 In:. k i ml*. nl »;,imi i h *. I i aictjy liv'd liy suc¬ 
cessful iiuliviilu.ils .mil group-. in i>b t «■ i n i ikj tci.linii.il inlimn.it ion; t he 
influence of l ink* .nut I'in.mi i.il ,»nd ioimminit.it i«>n i tins I r.iinl*. on vvri li 
s t r.iteqy; the influence of simmIi strategy on .-l lie pmxIucI i vi ty ol me 
individuals tiiul groups. 

The study methodology employed in the v.tt ious tasks m.ikin«] up 
Project HINDSIGHT is described in detail in section 2, "Objectives; 
Strategy anil Melhoiloloyy." Conceptually, the proceilui es are siiimnai i/ill 
,in the following paragraphs. 



Task I: RXI ) Events 

Research in science and technology is a continuing activity of the 
Department of Defense. If this activity is of Value, it would be logi¬ 
cal to expect that a generation of weapon systems would evidence the 
consequences of this research—that it would be based not only on the 
scientific and technical foundation of preceding generations, but on new 
knowledge as well. This assumption provides the basis for the historical 
studies comprising Task I of Project HINDSIGHT. 

The Task I studies constitute the sole basis of this report. For 
this first task, 20 modern weapon systems dr military end-item equip¬ 
ments have been examined by teams of experienced scientists and engi¬ 
neers; for evidence of science or technology that was not aval table or 
was not utilized in predecessor systems. Having recognized the applica- 
tion of this new knowledge, the team undertook a deliberate historical 
trace of the component, technique or idea. The objective of the trace 
was to identify the people, the place and the time associated with the 
generation of the knowledge and with the contribution of significant 
additions by which the techndlogy reached the level manifested in the 
studied weapon system. 

The primary reason for Initiating.the studies through the investi¬ 
gation of specific weapon systems is to-f.ores.tal 1 any doubt concerning 
the value of the scientific or technological contribution. The focus is 
on utilized resuits of investment in research. Project HINDSIGHT is not 
concerned with management of weapon-system development except when les¬ 
sons may be drawn from the role of project managers in fostering new 
scientific or technological knowledge. 

The nature and depth of information sought by the Task I study 
teams are demonstrated in Appendix C, the form used for RXD Event de¬ 
scriptions. At the completion of Task I, 710 RXD Events had been iden¬ 
tified, historical traces had been made, the related activities had been 
described in terms of the differential amount of knowledge that accounts 
in part for the increased cost-effectiveness of current weapon systems 
over that of their predecessors. It is estimated that this number rep¬ 
resents between one-third and one-half of the RXD Events that might 
have been identified by a more exhaustive analysis. 
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Utsk II: Behavioral Studies *: 

iask i 1 studies >jrv focused on tin.*: Ufli.jvioi.il cliui «jlI cr i st.i i 1 , «,I 
individuols wiit: conlributt'd Ur* u l i !i zed know I edge . Management ,in,i lys t •, 
arc perl'unni ntj do toil ed s t ml i eh of ,i sampling of organizations awl indi¬ 
viduals identified in Task I. Areas of investigation include—but ar e 
not I i tit i tod to—idea transfer, skill development, motivation, utilized 
information sources, and tin* role of the technical liaison matt. As each 
study is completed, the results will he reported, and the series of 
topic-oriented essays will be consolidated and published by the Office 
of the Director of Defense Research and Engineering, probably not until 
late in I 9 & 7 - It is anticipated that the behavioral studies will be 
continued. 


Task III: Econom e tric Studies " 

Task III addresses the problem of defining and implementing a tech¬ 
nique (or techniques) for the quantitative analysis of the value of in¬ 
vestment in scientific and technological research—its value, that Is, 
in terms of enhanced cost-effectiveness for the resultant weapon systems. 
A limited effort to achieve a quantitative value differential—aqain, In 
terms of predecessor weapon systems—has been undertaken by each of the 
Task I study teams. To the extent permitted by security restrictions, 
their findings are reported here. Although a more rigorous approach is 
being sought by the Institute for Defense Analyses, a useful solution to 
this very complex problem has not yet been found. Efforts are continu¬ 
ing, and success will be reported if and when experienced. 

* * vt 

The remainder of this report addresses the hypotheses stated on 
pages 2 and 3 to the extent permitted by the data collected through the 
studies and Investigation conducted under Task I. 

Because a number of research procedures were invented for this 
Study or were adapted with marked changes from procedures commonly used 
in behavioral and other social science research efforts, attention Is 
given in section 2 to methodological details of Project HINDSIGHT. This 
study, descriptive rather than normative in character, concentrates on a 
very special class of activities—research efforts whose results are 
known unequivocally to have been utilized. By focusing on this special 
class, Project HINDSIGHT accepts the risk of some potentially significant 
errors of omission. The most apparent of these are discussed and their 
possible consequences evaluated in section 8, "Methodological Validity." 


*Note: Tasks II and III were discontinued In favor of other 
related DoD studies. 










t ‘. OBJi CT1VI S, Sl'KATICY AND Ml IHOUDLOGY 

?.l 01. joel .iv y's . ;■ . ; 

Ilu' primaiy objectives «l I'nyed »IN0VI(iHI, uviubli-.lK-d t»y the 
D.iivctoi of' Defense Research and Engineering (l)UKM) In July !*|6!» (>w; 
Appendix A), were as follow!.: 

(a) lo identify, aiid Tinnly establish Management 
factor*! for research and lee lino logy program*. which 
luive been associated with the utilization of results 
produced, by these programs; "(b) to measure the over¬ 
all increase in cost-effectIveness In the current 
generation of weapons syslews compared to I heir 
predecessors (when such can be identified) whicii is 
assignable to any part of the Lota I Bob investment 
in research and technology. 

The DDRSE's memorandum concluded several preliminary investigative 
studies undertaken by the Deputy Director of Defense Research and 
Engineering (Research and Technology) and accomplished during the pre¬ 
vious year, partly under contract with private industry 1 and partly 
in-house'. The pilot studies had demonstrated that at least the first 
objective was reasonably achievable and had provided insight with 
regard to more promising procedures. 

2.2 Strategy and Methodology 

The fourfold strategy adopted for satisfying the objectives was . 
relatively simple in concept and may be summarized as follows; 

(1) Determine the extent to which new weapon systems are ac¬ 
tually dependent upon the results of recent advances in science or tech¬ 
nology for their attained increase in system effectiveness, decrease in 
cost, or increase in cost-effectiveness as compared to a predecessor 
system. 

(2) Determine the proportion of any new technology, required 
for attaining system characteristics, that was the result of DoD- 
financed research in science or technology. 


^ Management Factor's Affeating Research and Exploratory Development, 
Arthur D. Little, Inc. (Springfield, Virginia; Clearinghouse for Federal 
Scientific and Technical Information, AD 618-321, April 1965 ). 

7 A trial Study of the Research and Exploratory-Development Origins 
of a Weapon System—BULLPUP (Washington, D.C.: Office of the Director of 
Defense Research and Engineering, 15 December 196^). 
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Table 1. PR0JLC1 HINDSIGHT WEAPON SYSTIMS 


Designation 

Type of weapon system 

HOUND DOG 

Air-to-Surface Missile 

BULLPUP 

Air-to-Surface Missile 

POLARIS A-1 

Submarine-Launched Ballistic Missile 

MINUTLMAN I 

• : • ■■■■■■■ -V v • V 

Intercontinental Ballistic Missile 

MlNUTFMAh 11 

Intercontinental Ballistii Missile 

SERGEANT 

Tactical Ballistic Missile 

LANCE 

Tactical Ballistic Missile 

Mark 46 Mod 0 

Antisubmarine Torpedo 

Mark 46 Mod 1 

Antisubmarine Torpedo 

M-102 

105mn Howitzer 

FADAC 

Field Artillery Data Computer 

AN/SPS-48 

Surveillance and Acquisition Radar 

Mark 56 

Sea Mine 

Mark 57 

Sea Mine 

Starlight Scope 

Passive Night Vision Device 

C-141A 

Strategic Transport Aircraft 

Navigation Satellite 

Low-Earth-Orbit Satellite 

M-61* 

Nuclear Warhead, General-Purpose Bomb 

M-63* 

Nuclear Warhead, Missile 

XM-409 

152mm HEAT-MP Cartridge, Ammunition for 
SHILLELAGH Antitank System 


Note: *Data on these two systems are insufficient to warrant their 
inclusion in all analyses. 
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U) Determine s.ighi f kant inuiuyeiiienl .mil otbei i-nvi 1 unmenta I 
factots, ,ts seen by the if-,<*,! 11 . Ii st ii-u list at eiigiiu ei , th.it appear to 
he coilmen su fate with high tit 11 iy.it ion of lesenrch results, 

(<t) If the I killings 0! • the first sliuteyy indicate a signilj- 
Cdnt reliance, on new science or technology, devise a value-cost index 
(or set of indices) which offers o quant I lotivu measure ot the return on 
investment In research, In letnis of -the enhanced cosl-effectivunuss of 
the weapon systems made possible by the purchased knowledge. 

2.2,1 First Strategy—Significance of Recent Advances : The find¬ 
ings based on the first strategy were a key to the entire study. To 
allow making quantitative measures within the other strategies, it was 
necessary to establish the general dependence of new weapon systems upon 
new science or technology and, even more important, to identify the 
specif ic comribut ions of research that were used. The pi lot studies 
had defined three of the critical factors influencing the probability of 
success in this task and had strongly suggested a fourth. 

The /Vihft ej'/.t/Vn/ fiiclov was the recognition that the contributor*, 
of scientific or technological knowledge, particularly at the more basic 
stages, are infrequently aware of many eventual applications of that 
knowledge. Thus, in order to ensure identification of profitable re¬ 
search, it was necessary to begin the search with the evidence of appli¬ 
cation to a specific weapon system and then trace backward in time the 
succession of contributors to the knowledge bank. To this end, 13 weap¬ 
on systems were selected for analysis in addition to the seven providing 
the bases for the pi lot studies. The total list of weapons and weapon 
systems is shown in Table I. 

The criteria for selection ensured representative samples of as 
many of the main categories of Defense weapons as possible; wherever 
practicable, systems having generally comparable predecessors were chosen.. 
No attempt was made to select systems on the basis of suspected high 
utilization of new technology. 

The second critical factor identified in the pilot study was the 
sensitivity of results to the total previous experience of the investi¬ 
gator. In retrospect, the problem is easily understood. The investiga¬ 
tor Is asked to analyze a system in order to identify the results of 
recent research. The most practical and efficient basis for the jidg- 
ments he must make is his own experience. A young scientist or engineer, 
no matter how brilliant, generally lacks background. This critical fac¬ 
tor and the fourth, suspected one Were circumvented simultaneously. The 
pilot studies had suggested that there was reason to believe a contract 
study group would find its efforts impeded by such matters as proprietors 
interests within the laboratories of the research performers, the level 
of its knowledge concerning the management of In-house and contract re¬ 
search efforts of the DoD, and the relatively low degree of private 
industry's responsiveness to an associate as compared to that shown a 
Government agency. The adopted solution to both of these problems was 
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niltt'U by llit* /V.si-.l.ml Sft'ii’l iii y (Ko .imi'cIi .iml Lh-v.-I opim-hl) i.l tin- 
Mi I ili*ry Department that tlt'Vt* lopetl I In - weapon system. Hu- prim ip,il 
source ol team members was I lit* in-house In hoi nior if.. Individuals were 
selected and l imiiis bn lanced ,u> ensure the pieSeiue of ili<> irquiied tech¬ 
nical experience. loch team was responsible .Iidj? ilu- study ul wu; sys 
U’iii, excep l l Iki( in two cases if w»i*. found pi .1 < I i 1.1 1 1 01 >1 I i-.iim i t> ■. 1 inly 
0 pair ul’ systems. On Ilu.' average i.L look a lx jut three months lu I udy ,i 
single weapon system, the cutoff date bo. intj primarily .1 (million of 1 lie 
iippart'iii val idity and 'usefulness of ilu- somp.le ol infoimnl ion col I«-t. 1 i.-rl. 

1 11 response to the DDRfcE's . request, ilu* Saud i a Ctii porat ion inuk-riool 
studies of two nuclear weapon systems. Conceptually, this effort par.il 
ieled 'the work of the OoD iu*liouse teams, but the 26 •RXD I vents idenii" 
l ied were not reported in as great detai l os the pi imary set <if 68 , t 
Events described by the Government, ilivesily.ilors. 

two system studies were accomplished by (.lie very close involvement 
of the Deputy DDR&E (Research arid Technology)the Director ol Project 
HINDSIGHT, and principal members of the scientific and technological 
teams that had developed the systems. .These weapon systems were rela¬ 
tively small and were somewhat unique 'rr. that most of the research and 
development on both of them was done under the cognizance of one person. 
As a direct consequence of the meetings between the Project HINDSIGHT 
principals and the performing groups, utilized scientific and technologi¬ 
cal advances were Identified. A professional technical editor followed 
up the meetings to collect detailed information on those RXIJ Events. 

The other group studying two systems was made up of scientists and 
engineers from the industrial organizations that participated as prime 
contractors in’the development of the weapon systems. The anticipated 
difficulties, as described in the introduction to this report, were en¬ 
countered. It appears to be reasonably well established that this type 
of study must be made by OoD in-house people, either ad hoc teams or 
assigned personnel; each of these alternatives offers some obvious ad¬ 
vantages. 

The third and final ari Ideal factor was the operational definition 
of a discrete scientific or technological advance. The definition had 
to be used by a number of independently operating investigators with 
some assurance that each, upon identifying the same advance, would de¬ 
velop a mutually corresponding description. Because the advance Identi¬ 
fied would eventually serve as the basis for management studies, it was 
desirable that the activity described be of sufficiently short duration 
that a single manager or fiscal policy would be involved and the research 
perFormers would be readily identifiable. 
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whit'll (lit*' itltsi wn*. sub jet led to initial exami lint ion 01' !»■«,• / Ihe l<XI) 

Lvent tlillti*. i roni nllK-njist* vinii I.ir human endi-nvni *,. sole |y in that the 
Iv.iimi hi .•vtmiiMliiHi i-> piiw.it ily •« ‘a tent if i« oi uJino logical explo- 
I.it ion.' A more del ailed tit* I ii-it i«»n «.| l lit* IUD 1 vent i> given in Appen¬ 
dix B. which .iKo tic I ini", ’‘inter f.ice activity," tin* process l*y which 
knowledge generated in ah KXDI vt-nl is iron*, ferreil I i oiii I he lit.I 
innovator to the second—and so To i Is ut i 1 iz.it Ion. 

f.uii team began its study by examiii ing sys I om documental ion, ana- 
ly.-ing system design amt tleta i I s ol major component s mid subcomponents, 
and discussing technical matters with the weapon-system development en¬ 
gineers to obtain clues to the possible use ol new science or technology. 
Each clue then became a trace initiator; anti, to the greatest extent 
possible, the current user of the item was asked to identify liis source 
document or individual. Then the source was interviewed for tlie samc- 
inl'ormal ion, and the process Was repealed until the historical trade of 
the central concept terminated with the discovery of the originalor(s). 
Upon the location of the initially responsible person, the period ol ltit* 
RXD Event Was defined, and the required information was collected and 
displayed as shown in Appendix C. 

To minimize the reporting loacf on the investigators, ensure an even 
writing quality, and'provide a check on the relative completeness, of 
detail in each Event description, a single technical-editing service was 
established, The technical editor was also responsible for converting 
quantifiable information to a punched-card formal, which facilitated 
data processing, and for collecting biographical rtisumCs from the people 
identified as participants In the RXD Events. In the latter effort, the 
technical editor was supported and assisted by members of the study teams, 

At the conclusion of its investigation, each study team prepared a 
summary report, which serves two functions: First, it highlights the 
team's observations regarding'management, fiscal, environmental or U*ch- 
nological factors that appear to be associated with the conduct or sup¬ 
port of tiie utilized research or the transfer of research results to 
application. Second, it presents a crude measure of the consequence of 
using new science or technology in terms of increased cost-effectiveness 
of the studied system as compared to that of its predecessor. These 
reports, whose security classification varies from open to Secret, have 
been given limited distribution within the DoD. 

2.2.2 Second Strategy—Proportion of New Technology Financ e d by 
the DoD : The second strategy of Project HINDSIGHT was to determine the 
proportion of the new technology on which new systems Were based that 
was a result of DoD-financcd research In science and technology. The 
information needed for these analyses was collected in the course of 
preparing the RXD Event descriptions. In most cases the general source 
of financial support for the research worker could be readily determined. 
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Vdble II, CLASS! S OF RLSIARCII AND I XPl.ORAlDRY DLVU.OI’M! N1 
, SUGGESTLU IN PROJECT 111NOSIGISl 


Scjj 


_ i-m' class.; _; 

Investigations in pure and applied mathematics and 
theoretical studies concerning natural phenomena (k). 

Experimental validation of theory and accumulation 
of data concerning natural phenomena (R). 

Combined theoretical and experimental studies of new 
or unexplored fields of natural phenomena (R). 


Development of a new material necessary for the 
performance of a function (XD). 

Conception and/or demonstration of the capability 
to perforin a specific elementary function, using 
new or untried concepts, principles, techniques, 
materials, etc. (XD). 

Theoretical analysis and/or experimental measurement 
of the characteristics or behavior of materials, 
equipment, etc.i as required for design (XD). 


'First demonstration of the capability to perform a 
specific elementary function, using established 
concepts, principles, materials, etc. (XD design). 

Development of a new manufacturing, fabrication or 
materials-processing technique (XD mfg.). 

First development of a. complete system component, 
equipment or major element of such equipment, using 
.established concepts, principles, materials, etc. (AD). 


Notes: R - research 

XD - exploratory development 


AD - advanced development 
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In relatively few coses, about 3. b percent , tin? work had been charged t u 
an industrial ReD or overhead account and records were not available or 
were inadequate to def im> luiulinq input tot he .iccount s. Where this 
occurred, and in the interests of conservatism, it was albitrurily held 
that the funding was not the ttoD's, even though it might have been re¬ 
covered under ASP R“XV IR&D (i.e,, the provision in the d.-'e.v; ..Vca.' s is 

IhyuLu iou governing independent research and development). 

2.2.3 Third Str ategy-Factors .in the High Usage of Research 
Restilts : The third strategy was to determine management and other en¬ 
vironmental factors that appear to be uniquely correctable to high 
utilization of research results. Based upon the recognition during the 
pilot studies that investigative efficiency was extremely sensitive to 
the experience of the investigator, it was assumed that a similar situa¬ 
tion would obtain in the study of management factors. For this reason, 
relevant experience was sought and contract assistance obtained from two 
universities that have active management staffs in their science depart¬ 
ments. 

The university people were asked to draw upon their experience for 
hypotheses concerning the relationship between the environment and the 
probability that research results would be used. They were also asked 
to design experiments to test these hypotheses, using the identified RXD 
Events as test cases for the experiments. 

By October 1965, several hundred RXD Events had been cataloged. 

Aboi half of them had taken plac« In a rather small number of labora¬ 
tories of other organizations, while the other half was spread over al¬ 
most as mahy organizations as there were Events. In the interests of 
economy alone, it was obvious that a sampling study would have to suffice 
Events were categorized by their contributing organization, of which the 
10 most prolific were: 

Raytheon Company 
LliVg-Yemco-Vought, Inc. 

Rocketdyne Division, North American Aviation, Inc. 
Lockheed-Georgia Company 

Pratt & Whitney Aircraft Division, United Aircraft Corporation 
U.S. Army Missile Command, Redstone Arsenal 
, U.S. Naval Ordnance test Station 
U.S. Naval Ordnance Laboratory, White Oak 
Wright Air Development Center 
U.S. Army Munitions Command, Picatinny Arsenal 

Because it was sensitive to the systems that had been studied, the 
selection did not necessarily indicate the relative quality of the or¬ 
ganizations; but it did provide an efficient way of economically maxi¬ 
mizing the sample size for detailed management studies. 

In November 19&5, these 10 organizations were asked to participate 
in Project HINDSIGHT by making available a resident management scientist 
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Table III. UNDIRECTED RISF-AKCH 


1. Observation of phenomena. 

2 . Formulation of hypothesis. 

3. Design of experiment to test hypothesis. 

4. Conduct of experiment. 

5. Analysis and interpretation of results 
within the scientist’s frame of reference. 

6. Report to the scientific community. 

Table IV. DIRECTED RESEARCH 

1. Statement of problem. 

2. Morphological survey of available and 
apparently relevant knowledge for a 
possible solution, or deliberate search 
for new knowledge leading to a proposed 
solution. 

3. Design of experiment to test proposal. 

4. Conduct of experiment. 

5. Analysis: and interpretation of results 
within the frame of reference of the 
problem. 

6. Report to the "source" of the problem. 
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lu coiuUu'l uii-sjlc i*xjn*» elm’ll Is dcs i by the universities, 
iu resident in,in.H|i*nu*iil -.demists was t.unsideied desirable luf at le.isl 
thiee reasons’ First, the individual's know ledge of.bis oiqvmi/ul iui 
ami its peuplv could save a considerable .iinouul of study lime.- Second, 
management would be assuiod llmi piopi let ary interests were pioteclud. 
Third, because the designated inanagewenI sciunlisls would not be intio- 
dured to the test.hypotheses until altei the experiments were conducted, 
bias would be minimum. : 

By December I965, one t»l tin* universities had conducted bt ief 
courses ol instruction to fanii I iar'i/e the resident management scientists 
with study objectives and the proposed methodology. Distribution of 
lest instruments began in January 1966; the collection and analysis of 
data are expected to continue well into 196/. Primary analysis is the 
.final responsibility of it lie supporting universities. Their reports will 
be collected, collated, credited and published by the Project HINDSIGHT 
of I i ce. • •' 


2.2.** Fourth Strategy— Value-Cost Index : The fourth strategy 
called for defining a value-cost index, or set of indices, offering a 
quantitative measure of the return on Investment in research. From the 
beginning, this was recognized ai> ltic most difficult task undertaken by 
Project HINDSIGHT. Because the econometrics of the detailed studies was 
foreign to most of the scientists and engineers identifying the RXD 
Events, the conceptual cost^-value studies were assigned to separate 
groups. At the time this report was prepared, however, significant prog¬ 
ress had not been made. 

2.2.5 Definition of Terms : During the pilot studies it was dis¬ 
covered that the current DoD definitions of research (R&D category 6.1), 
exploratory development (6.2) and advanced development (6.3) were inade¬ 
quate for use in recognizing, classifying or administering research in 
science or technology. A more useful classification scheme (see Table 
II) was gradually developed during the pilot studies and, on the initia¬ 
tion of Project HINDSIGHT, was adopted without change. The successful 
application of this classification system throughout the studies has 
demonstrated its utility. 

Although adequate to provide a functional description of the several 
classes of research in science and technology, this categorization did 
not serve as a vehicle for identifying motivational factors. Further, It 
was obvious almost from the initial collection of data that the problem 
of semantics could represent a formidable barrier in the description of 
scientific research activities. Solely to minimize the Impact of this 
difficulty, definitions were adopted for two terms used in this report; 
(1) undirected (or disassociated) research and (2) directed (or respon¬ 
sive) research. 

The definitions, shown In Tables III and IV, are arbitrary, and are 
recognized as describing only the two ends of the spectrum. For purposes 
of Project HINDSIGHT, however, they were found operationally useful, and 
so are used as a frame of reference in the pertinent data analyses. 
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3. THE SYSTLMS STUU1LU 


It was obvious that the selection of weapon systems and military 1 

equipments for study under Project' HINDSIGHT would influence the find¬ 
ings. The nature and extent of this influence, however, could not be 

assessed without prejudging the eventual findings. j 

For example, the greater part of the Army’s weapons inventory con¬ 
sists of relatively ordinary items such as rifles, howitzers, tracked 
and wheeled vehicles, radios for short-range communicat ions, and the 
like. For most Army operations, these equipments are at least as im¬ 
portant' as the more "glamorous” guided missiles and tactical nuclear 
warheads. If it were a fact that, for the former class of weapons, the 
scientific and technological base came from the general civilian economy 
and that, for misslies and warheads, it was the result of military- 
supported research, any undue attention to either class in the HINDSIGHT 
study would lead to distorted findings. 

In a similar vein, if little or no new science and technology were 
going Into modern rifles, howitzers, mortars, trucks, etc.—a situation 
that seemed rather unlikely but could hot be arbitrarily ruled out be¬ 
fore the study began—then any findings based on studies of satellites 
and advanced radars would not be amenable to extrapolation or other 
statistical inference^ To. ensure that the findings would be reasonably 
valid, HI NOSIGHT had recourse to a sampling technique for system selec¬ 
tion, npt a truly random sample, but a controlled one to achieve an 
apparent balance of equipment types: 

The weapon systems and equipments that served as the basis for this 
study (see Table l) are briefly described in the following pages. 

3.1 HOUND DOG 

HOUND DOG is a jet-propelled air-to-ground missile with a nuclear 
warhead and a steMar-monitored, all-inertial guidance system. It is 
ajr-launchecT from a pylon beneath the wing of a B-52 aircraft. The mis¬ 
sile operates in either a high subsonic or a supersonic mode'and has an 
operating range in excess of 350 nautical miles. 

Weighing approximately 12,000 pounds, the missile has delta plan- 
form wings in a canard arrangement; the wing is located well aft on the 
fuselage and the horizontal stabilizer Is placed at the nose. The fuse¬ 
lage, an ogival nose faired Into a long cylindrical afterbody, contains 
the guidance package, the warhead and all other subsystems, except that 
the power plant is suspended far aft in an engine nacelle beneath the 
fuselage. 

Development of HOUND DOG began in 195& and was essentially complete 
in 1959. 
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3.2 BULLPUP 


BULLPUP is an jit— to-ground missile, optically tracked ,tml rudio-- 
command-guided, intended for use against tactical targets such us trains, 
bridges, tanks, truck convoys, ships and ground Weapon emplacements. 
Aerodynamic control surfaces are on the nose Of the missile (canard con¬ 
figuration), and delta wings provide primary aerodynamic lift. This 
uncomplicjlud, relatively inexpensive weapon has a designed maintenance- 
free shelf life of 5 years and can be loaded on an aircraft in minutes 
with no checkout or other ground support. 

Different versions of the BULLPUP missile use either a solid- 
propellant or a prepackaged 1iquid-propellant rocket motor. The smaller 
BULLPUP A can delivet a 250-pound conventional warhead over a range up 
to approximately 6 miles from the poini. of release by the launching air¬ 
craft. The larger BULLPUP B carries a 1000-poUnd conventional warhead 
over a range of some 9 miles. 

In operation, the pilot of the launching aircraft monitors the mis¬ 
sile in flight by radio and controls its path by keeping flares in the 
missile's tail lined up with the target. 

Development of BULLPUP A was initiated in 19.5*1 and led to a first 
production run in early 1958. The fi rst production contract on BULLPUP 
B was awarded in I960. 

3.3 POLARIS A-1 

POLARIS A-l was the first of the series of submarine-launched, 
inertially guided, intermed!ate-range ballistic missiles. The A-l was 
small in comparison to contemporary missiles of equivalent range, could 
be launched from a submerged submarine, and had high Inherent reliabil¬ 
ity and relatively low.maintenance requirements. 

Its solid-propellant rocket motors were capable of delivering a 
nuclear warhead over ranges well in excess of 1000 nautical miles with 
an accuracy commensurate with the navigational precision of the launch¬ 
ing submarine. 

Despite the important Increase in combat potential offered to the 
fleet by the introduction of POLARIS A-l In 19&0, the system's develop¬ 
ment had exploited surprisingly little really new technology, especially 
in view of the relatively much greater amount that was used In the A-3 
version. Undoubtedly this was partially a consequence of the A-l's very 
tight development schedule, which allowed ho freedom for long-lead-time 
efforts. Pre-ig^S torpedo-launch technology was the chief basis for the 
launch-tube mounting and missile-ejection system; a portion of the mis¬ 
sile's suspension, or shock-mitigation system was developed from air¬ 
craft arresting-gear technology; the inertial guidance system, computer 
technology arid the nuclear warhead were no doubt state-of-the-art 
developments. 



fho compressed dove I Opulent lime of llie POLARIS A-I is indicated by 
the f.ic t th.it not until April 1957 wore decision'. made regarding ihe 
plincip.il technical guidelines, yet a POIARIS sulmi.ir ine was at sea in 
June i960 —a lull 5 years ahead of the inifi.il taryet dale set in 1955- 

3.4 HINUTEMAN I and II 

MINUVEMAN is a 3 _ stage, solid-propellant, till inertially guided 
intercontinental balfistic missile. Project HINDSIGHT examined the 
technology leading first to MINUTEMAN I and then to its successor, 
MINUTEMAN II. This was done in ah' attempt to gain some understanding of 
how much new science and technology are involved in the marked upgrading 
•of functionally guite similar systems. 

The MINUTEMAN missile is about 55 feet long, reaches a velocity of 
over 15,000 milesper hour in flight, arid has a range of over 5000 miles. 
Motors of the first two stages are in metal cases,-while the third- 
stage motor, is encased in fiberglass*. 

The inertial guidance systeJn is a highly accurate arrangement of 
gyroscopes running on practically frictionless bearings. A digital com¬ 
puter contains a memory section which Stores the missile's flight pro¬ 
gram. During flight, the computer serves to compare the achieved f1ight 
profile with the Stored program, calculate steering corrections so as to 
maintain the" desired trajectory, and send signals to the nozzle steering 
system to keep the missile on course. 

A reentry system contains the fuzing mechanism and the nuclear 
warhead. 

A steel-lined concrete launch tube 80 feet deep houses the missile. 
Surrounding the launch tube, under several feet of concrete, is a two- 
level equipment room that is reached through a hatchway with a hydrauli¬ 
cally operated cover. This room contains systems for communications, 
launch control and monitoring, and electric-power conversion and dis¬ 
tribution. Additional equipment required for normal operation of the 
launcher is installed in a launch-support building a short distance away. 

3.5 SERGEANT 

This tactical Army missile can carry either a conventional high- 
explosive or a nuclear warhead up to a maximum range of approximately 
75 miles. The 35-foot solid-propellant missile is fired from a mobile 
launcher and is inertially guided to the target. Because of its high 
thrust-to-weight ratio, SERGEANT requires no booster. 

For mobility in the field, the SERGEANT missile is transported in 
sections on conventional Army trucks that have been slightly modified to 
accommodate the system. The warhead is carried in its own van, and the 
motor, guidance and stabilization-fin sections are moved on a semitrailer 
When a missile is to be fired, a suitable launching site is selected and 
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the principal voliic U*;» arc driven Intu pir.it ion. Lmplacwni-iit , 
assemhly, checkout anti preparation tor firing can be completed in a 

Development «.f SERGEANT began in Wjh, ami punluct ion conmencetl in 
i960. It was one of the first systems to employ a modular design con¬ 
cept. When a malfunction is detected during checkout, the foiled compo¬ 
nent is simply unplugged and a replacement assembly inserted. 

3.6 LANCE 

LANLE, another tactical Anny missile system, is being developed as 
an art!1lery-guided weapon to support the field army division. This 
3200 -pouiul missile is intended to carry a nuclear, conventional high- 
explosive or chemical warhead over a considerably shorter range than 
SERGEANT'S 75 miles. 

The propulsion system uses prepackaged storable hypergolic liquid 
propellant, which enables the same instant readiness provided by solid 
fuel, but also offers simplified variable boost and thrust termination 
for improved accuracy. LANCE is guided by a unique inertial reference 
and automatic meteorological correction scheme. The missile is direc¬ 
tional ly control led by steering the rocket exhaust. 

The LANCE missile is about 20 feet long, and its cyfindrical body 
is about 22 inches in diameter, it is stabilized by cruel form clipped 
delta fins with an overall span of about A feet. 

Among other components of the LANCE system are a self-propelled 
launcher, convertible to a lightweight towed launcher, and a self- 
propelled missile transporter-loader. With this equipment, LANCE will 
have cross-country mobi1Ity and will be deliverable by fixed- or 
rotary-wing aircraft and by parachute as well. 

3.7 Torpedoes Hark 46 Hod 0 and Nark 46 Mod 1 • 

These torpedoes are antisubmarine weapons designed to attack tar¬ 
gets at all operational depths. About 9 feet long and slightly over a 
foot in diameter, both torpedoes can be delivered by either aircraft or 
surface vessels. They have essentially the same self-contained guidance 
system, which enables the torpedo to locate and attack targets within 
its search volume with no external assistance. Warheads in both-cases 
are conventional high explosive. 

Primary technical differences in the torpedoes are found in their 
engines and steering concepts. The Mod 0 uses a solid-propellant fuel 
to drive a hot-gas engine; the Mod 1 has a liquid-monopropellant cam- 
engine propulsion system. Control in the pitch and yaw planes for the 
Mod 0 torpedo is achieved by tilting a shroud ring that encompasses the 
counterrotating propellers.. Roll control is provided by fin tabs. The 
Mod 1 uses movable fins for control in all planes. 
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Development of the Mod 0 was under token in I Sl>H , and fiiM deliv¬ 
eries to the fleet were made in 1963- Because it uses many of the proven 
components. of the.Mod 0, the Mod 1 development, which started in 
was completed in about 2 years. 

3-3 105mm Howitzer M-10 2 

This howitzer was designed for llui role of a conven1ionn1 light 
artillery piece, although many of its characterisiics are unconvent tonal. 
Most artiMery pieces, once emplaced in firing position, have a limited 
ability to traverse in azimuth (typically on the order of 60 degrees) 
but the M-102 can traverse a full 360 degrees. In addition, improved 
steels were used in the construction of barrel and breech, which permits 
higher internal pressure and thus a considerably greater range than its 
105mm predecessors. 

In spite of these advances, the weight of the entire howitzer was 
kept low enough to permit transporting it by helicoptfer. 

Early models of the M-102 were made available to the Army in 1962. 
3-9 FADAC 

The field artillery data computer (FADAC) is a general-purpose 
digital computer that, has been designed and tailored to assist the 
artilleryman in the solution of fire-control and survey problems. 

Classified by the Army as a standard equipment In 1961, this com¬ 
puter can be used with all classes of artiMery and a number of the 
Army's missiles, including LANCE. 

FADAC is about 12 inches high, 27 inches wide and about 3P inches 
deep, and weighs approximately 190 pounds. Despite its small size, the 
magnetic-disk primary memory unit has a capacity of 3192 words. 

3.10 AN/SPS-lt8 Radar 

This system represents an answer to the current fleet requirement 
for a practical "3-D" radar capable of simultaneously performing multiple 
functions, such as ,air surveillance, control of aircraft intercept, tar¬ 
get designation for weapon-control systems, and provision of information 
for use in evaluating the air battle. Earlier radars were limited to 
providing information in only f. a of the three coordinates—azimuth, 
elevation and range; the designation "3-D" indicates the added tjiree- 
dimensionai capability of this new radar. 

The antenna of the AN/SPS-48 is mechanically rotated in the hori¬ 
zontal plane to aequire azimuth information. A 9 _ penci1-beam pattern in 
the vertical plane, with electronic switching, provides elevation data. 
The radiating elements are windowed slots in the transverse wave guides 
making up the planar array antenna. The array is ehd-fed by a serpen¬ 
tine wave guide. 
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Tlu* radar was dvsiyiuHl primarily for insMt lal ion on guMt*d-miv*.i le 
frigates >uul doslroyi-rs. It is computer stabilized to remove perturba¬ 
tion* in data arising from ship's pitch anti roll. 

The Navy'sJcvelopment of the SPS-48 began in the early 1560s. A 
production model was Installed in the USS ViOKDEN during the first'half 

. of 1565. 

3-11 Hines Mark 56 and 57 . 

The Hark 56 is an aircraft-laid moored mine In fhe 2000-pound class, 
designed for employment against submarines, the Mark 57 mine is its 
submarine-iaid counterpart. Both use conventional high-explosive war¬ 
heads. 

Conceptually, these weapons arc not significantly different from 
their predecessors-of World War II. Because of advanced design details, 
new materials and recent technological developments, however, they offer 
considerably increased lethality, sensitivity and resistance to counter¬ 
measures, the ability to operate at much greater depths, increased Shock 
resistance to airdrop, and much greater overall reliability. 

The major differences in the two mines lie in their markedly Indi¬ 
vidual means of deployment—-the Mark 56 from the wing of a high-perform¬ 
ance aircraft, the hark 57 from a submarine's torpedo tube. 

The current version of the Mark 56 mine was released to production 
in 19&3; production of the Mark 57 started 3 years earlier, in I960. 

3.12 Starlight Scope 

The Army's Starlight Scope is a night^-vision device that can be 
either hand-held or mounted on a tripod for use in observation and sur¬ 
veillance when It is too dark to see with the naked eye. the instrument, 
which looks much like a telescope or a rifle scope, can also be mounted 
on weapons to enable aiming at night. 

This passive device employs the principle of image intensification 
to raise the light level in the viewed scene above the human eye's level 
of sensitivity. It was released to field use In 1965. 

3.13 Strategic Transport Aircraft C-141A 

The JC—141, a 4-jet-engine aircraft with a crew of 8 men, was de¬ 
signed to airlift all the military services' combat or support units and 
(military supplies, delivering them by landing or by parachute, as re¬ 
quired, It can carry 154 soldiers with their individual equipment or 
80 litter patients and 8 attendants. Alternatively, it can carry about 
a 31-ton payload.over 4000 nautical miles at an average speed of 422 
knots. 
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Tht? aircraft is IVj lout Iona, has <i wing span of jppioxinuituly 
160 loot and .1 maximum height of almost *10 fuel. 11 s serv i te ce i 1 ing is 
over <i <1,000 feel. Maximum speed at .Hi aV t i tude of 76,000 feel is about 
500 knots. 

The letter contract authorizing the development of the C - 1AIA was 
doted April l*)6l, and the aircraft saw its first service in October 
f96b. A unique aspect of its development was that the initial contract 
required the aircraft to be certifiable by the Federal Aviation Agency 
for commercial use in addition to satisfying mi Iitary requirements. 

3.14 Navigation Satellite 

This artificial satellite, launched Into a low earth orbit, makes 
it possible to determine a shipi's position accurately regardless of 
weather or the anomalies of low- and medium-frequency radio propagation. 

By monitoring the Doppler sh]ft in the ultra-high-frequency signal 
emitted by the satellite, the navigator can determine the instant of the 
Satellite's closest approach to his location and the slant range between 
the two points. Using time-feference information in the radiated signal 
and published data on the satellite's orbital parameters, he can compute 
his position precisely. 

The concept of a navigation satellite appears to have been consid¬ 
ered seriously in late 1957 or early 1958. In September 1963, a satel¬ 

lite was actually used in ship navigation. The first truly operational 
navigation satellite was placed in orbit on 6 December 1963, providing 
the U.S. Navy with'the most .reliable, precise all-weather global navi¬ 
gation system ever developed. 

3.15 Nuclear Warheads M-61 and M-63 

These nuclear warheads, now being introduced into the weapons 
inventory, are advanced versions in comparison to their predecessors. 
They use nuclear material more efficiently, have improved structural and 
mechanical features, and possess greater adaptability to design con¬ 
straints imposed by the weapon-delivery system. 

Because of security restrictions, the warheads cannot be more com¬ 
pletely described here; those considerations also preclude, subjecting 
them to the same type of study as that adop"*d for the other weapon sys¬ 
tems surveyed under this Project. 

The study of the M-61 and M-63 nuclear warheads was limited to a 
sampling of RXD Events that the study team believed to be generally 
typical of advances in the non-nuclear components of nuclear warheads. 
The samples were Small and contained less detail than those of the other 
18 systems studied. 
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The Sheridan is a new armored reconnaissance vehicle developed by 
the Army to replace the post World War II light tank. Its main armament 
features a 152mm gun-launcher that 1 fires either the highly accurate anti¬ 
tank SHILLELAGH guided missi le or a relatively unconventional ar+H-hriy''— 
projectile. The complete arti(lery round of which that project i le is a 
part is the 152mm HEAT (high-explosive antitank) HP (multipurpose) car¬ 
tridge XH-^09- The "MP 1 * designation means that the annum i tioncan defeat 
both hard and soft targets. 


The cartridge case, which is completely consumed within the gun 
barrel when the round is fifed, is a two-piece assembly, manufactured by 
a felting process from nitrocellulose and Kraft fibers with a resin 
binder, . The projectile consists of a one-piece forged-steel body which 
is loaded With approximately 6.5 pounds of Composition B. The high- 
explosive charge is shaped so as to provide, on being fired, an extreme¬ 
ly intense focused jet of energy; this represents the weapon's ant 1 lank 
kill mechanism. Fragmentation of the projectile's steel body provides 
the capability for defeat of soft targets. 
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1 hi* ijimu-imI object ivc> anil slratogio-. ul PuijiKl HINUSIOHI 
described in section 2, am! sonic ailili I iuii.il spi-cilic quest ions to which 
tlic study was addressed were set I'm I It in t he ini loduct inn. Hu- findings 
ot this Project, in lenns of lliose yeneiial idijec t ives, stiateqies and 

l'he‘ study approach adopted loi Pruject HINDSIGHT is such tiidl. in 
the purist's sense, the Tiiulihys frequent ly are indicative rather than 
conclusive. This acknowledgment in no way weakens the significance cl 
the findings, but recognizes only that the complexity of the processes 
studied is;so great as to preclude ini exhaustive under-,landing. Mure 
specifically, it concedes that a great variety of management patterns 
have been shown, by at least one example, to be workable, Nevertheless, 
the HINDSIGHT data indicate that'some patterns, by the frequency of 
thei r‘appearance, are more likely to be associated with research efforts 
whose results are utilized. 

Whenever possible, data are presented as time-dependent distribu¬ 
tions, dr as percentages of a total, to afford an estimate of Lhe rela¬ 
tive degree of confidence that may be assigned to the val idity of the 
indication or finding. 

In some cases, interpretation of findings was found to be extremely 
sensitive, either to the precis ion with which certain words are defined 
or to the manner in which those words arc used. This problem was en¬ 
countered early in the study, and operational ly useful definitions were 
invented or adopted. As pointed out in section 2, the most sensitive 
areas involved-r 

. the general classification scheme for RXD Events and 

. the delineation of basic research in science undertaken to 
satisfy the curiosity of the scientist, as distinguished from that under¬ 
taken for more pragmatic reasons. 

Classifying the sources of new scientific or technological knowl¬ 
edge in terms of organizational type—DoD laboratories, universities, 
industries—presented no especial problem, except that |t failed to 
provide insight into the motivation of the performers. To overcome this 
weakness, an additional classification scheme was adopted which divides 
all research Into two categories.' One, referred to in this report as 
undirected (or disassociated) research, is conceptually described in 
Table III; and the other, termed directed (or responsive) research, is 
described in Table IV. These definitions, or calegorizations, provide a 
frame of reference for pertinent analyses and discussions. 
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4 . I f i i si .Si iMt vijy : Deli-iiwiiu* fin* extent to which new weapon 
systtins .ire actually dependent Upon the 
resu11 v of /'i■■ -rut tfiii'iji.ssin stiviui* or 
technology for their attained increase in 
system effectiveness, decrease in tost, 
or ihcreaso in cost-offeci i veness .is 
compared to a predecessor system. 

If. 1.1 Fi nding : thirk< 'dig fVi/vw.'.i' uh-iipuii ni/S / , ■m« jvj; nil jS*«. 

I .s mldnity .t cimr.idt'iul'lr luunhcr of i: cirnt.ific on! Ivrhnolrjgi- 



A very early observation of the Project HINDSIGHT study was that, 
almost without exception, no single identified RXD Event or Combination 
of a very few Events is responsible for an appreciable portion of a total 
advanced capability. It Is most unlikely that the observation would hold 
true throughout a study of the first atomic-fission bomb, wherein a rel¬ 
atively small number of very significant Events involving Einstein, Fermi 
and a f^w other physicists apparently account for that capability. The 
observation, therefore, is generally limited to cases in which the prede¬ 
cessor and successor systems were technologically similar but unequal in 
cost-effeetivenes>. Even here, however, there are apparent exceptions, 
as in the case of the modern art I f iery howitier. This seeming discrep¬ 
ancy is treated later in the discussion of findings 4.1.2 and 4.i.3. 

The time distributions of the RXD Events, with regard to the dates 
of decision to undertake engineering development of the particular 
weapon systems irf which the new science or technology was used, form 
illuminating patterns. Representative distribution curves are shown in 
Figures I through II and are discussed in subsequent findings, 1 

4.1.2 Finding : There is a high positive correlation betweon the 
rcLiti'se sophistication of the predecessor and successor sgrtonr — or the 
'ivLilitu: increase in their effectiveness—and the amount of turn science 
• becirivlogy utilized in. the successor. 

The argument for this finding requires the appreciation of two back¬ 
ground factors: (1) the number of RXD Events that would probably have 
been disclosed by a more exhaustive treatment and (2) a measure Of the 
relative value of each Event. 1 

Figures 1 through II represent the RXD Events that were actually in¬ 
vestigated in detaifi Estimates of the percentage of coverage range 
from 20 percent for the C — 141A aircraft to 40 percent for the AN/SPS-48 
radar, 75 percent for LANCE, and over 95 percent for the Mark 5C and 57 
nines. The spread is a function of many factors. The percentages vary 
positively with the accessibility of the RXD Event's performers and with 

’Summary descriptions of these RXD Events and some of the more 
relevant data are given in Appendix D. 
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I he si/i* and d i I iijom i" of the study te.iin duel, inversely, with the com¬ 
plexity ul Lhe equipment studied. In the extent cunt ml lubl e, however, 
each sample is represent,it i ve ot the overall type til RXlJ Event culmi¬ 
nating in the specific equipment. 

Studying a relatively small number of Events that were sequentially 
related in a single scientific discipline or area of technology was 
generally preferred to pursuing many tentatively identified Events across 
a broad spectrum of technologies. Thus, there could be up to five times 
as many Events as have been counted. The distribution among the several 
classes of research and exploratory development, though, should remain 
essentially unchanged. 

The second factor, justifying alI contributing Events as equal in 
weight, can be supported by a simple illustration. The transistor is 
generally accepted as one of the most important scientific and tedhno- 
logical advances of the current period. Of what value would the tran¬ 
sistor be to an I CBM airborne guidance computer if the capacitors were 
large, leaky, wax-impregnated devices? ...if the Inductors and trans¬ 
formers used huge iron cores? ... if the power suppl ies were lead storage 
batteries or internal-combustion-engine-driven generators? ...and if the 
chassis and mechanical support were fabricated of low-yfield-strength 
steel? 

Recognizing the part that each advance plays in this mutually sup¬ 
porting effort, one can conclude pragmatically that all utilized Events 
have essentially equal value in a single weapon system. It is therefore 
meaningful to compare systems simply in terms of the number of Events 
required to achieve their demonstrated performance. 

The simplest weapon system examined was the M-102 105mm howitzer. 

This weapon shows an increase in effectiveness over that of its prede¬ 
cessor, the M-2A1 , in two significant parameters: To achieve practical 
transportabiIity by helicopter, it is much lighter In weight, and it of¬ 
fers an approximately 40-percent Increase In range. A significant part of 
of the weight reduction, along with the ability to withstand the higher 
internal pressure commensurate with the extended range, is attributable 
to a single RXD Event involving the production of better steel for the 
gun tube. Most of the remaining weight reduction was enabled by the RXD 
Event of welding aluminum. A few additional Events Involving propellant 
manufacture and barrel-erosion control provided for the increased range. 
Thus, starting with a relatively uncomplicated system, a total of five 
to seven Events resulted in a markedly improved howitzer. 



Conversely, for a somewhat comparable increase in effectiveness 
from MINUTEMAN 1 to MINUTEMAN II, some 50 technological advances were 
essential (see Figure 5). Thus, the greater the sophistication of the 
predecessor, the more new science or technology is required to achieve 
a useful improvement in cost-effectiveness. Where the predecessor 
systems were roughly comparable ip sophistication (a situation that gen¬ 
erally existed for World War II free-fall bombs and magnetic-influence 
mines), the study’s findings suggest that the relative increase in 














el loc tivenoys of Uu* sueiessors varies ill reel ly with the number of 
ul i I i/ed RXD Events. 

lor exjinpIe, some 40 to 50 Events were required to achieve un in¬ 
crease by a factor of about 4 between the free-fall bomb and the tSULLf’UP 
uir-to-surface missile. It took over 100 RXD Events lo increase the 
Hark 56 mine's effectiveness by a factor of 10 over that of the Hark 10 
mine. In each case, predecessor and successor are compared only with 
respect to roles that both could perform. 

Other paired examples that indicate the same trend can be cited. 

The sample si2e, in terms of number of systems studied, is inadequate to 
provide a useful quantitative predictor of the number of Events essential, 
for a desired increase in cost-effectiveness. However, crude analysis of 
the data suggests that such a predictor can be achieved. This matter is 
treated further In section 7- 

4.1,3 Finding : New weapon aye terms avc move dependent upon the new 
technology than on new science. 

Mainly, the systems studied were of the post-1945 period. 

Project HINDSIGHT adopted flexible criteria for the definition of 
rew or recent technology. 1 f the technology of interest was used in a 
cruder form in the predecessor system, the evolution of that technology 
was traced back only as far as the time the predecessor system was de¬ 
veloped, generally after 1945. If it was not used in the earlier system, 
the evolution of the technology, was traced back to about 1945. The cri¬ 
teria were relaxed somewhat for new science, accepting some RXD Events 
that occurred as early as 1935. Despite this double standard, 91 percent 
of the 710 completed RXD Events are classified as the results of research 
in technology, the remaining 9 percent, as the results of research in 
science. 

Further, less than 16 percent of the technologically oriented RXD 
Events were traced to a post-1935 science base. The other 84 percent 
came directly from the application of nineteenth-century unified theory, 
were the results of empirical research, or appeared as inventions not 
needing scientific explanation. 

The median cost of a DoD-funded Event of a scientific nature (R) 
was approximately $60,000; for a DoD-funded Event of a technological 
nature (XD), the median cost was about $45,000. In view of the differ¬ 
ences in cost and the percentage of RXD Events! oriented toward science, 
one possible conclusion is that a budget for research in mathematics and 
the physical sciences should be about 10 percent of the size of one for 
research in weapons technology, where the classifications shown in Table 
II for science and technology (R and XD) describe the total package, and 
where the sole objective is gaining knowledge for application to weapon 
systems. 
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]li i . i im I us ion cannot lx- applied urbi 11.it i ly us a test of cut rent 
|),»l) tuna a I local ions lor at least two significant reasons.' fiist, the 
conclusion is applicable only where the work el forts alt- divided in uc- 
coiilance with the definitions ol' j.ibli> II. The most cursory oxaminat i on 
ol the Doll's current research and exploratory-development pn/jecl struc¬ 
ture.shows that a considerable portion of its lescurch eilorts arc.ol a 
generally technological rather than scienl.il ic chaiacfer. Second, the 
Ill-pel cerrt factor does not allow for very necessary work in I lie life, 
behavioral, social and other sciences. 

4.2 Second Strategy : Deter*lift* the proportion of any new 
technology, required for attaining 
system characteristics, that was the 
result of UoD-financed research in 
science or technology. 

, 2.1 K i nd i ng : Tlh’lioPfinaiumtl Uu: majoi-it.y ofi/rograrrti: nupf'hj- 
'«./ n.v o.'/VuiV oi’ U-ehnotogij j'ov ucdpon-tsytUmn vnprovmxnt. 

Throughout the 1945-1.963 period covered by this study, there was 
almost continuous change in research budgeting, accounting and procure¬ 
ment practices. Records have been retired or lost, and seemingly little 
attention has been paid to historical accounting for expenditures on re¬ 
search in science or technology. As a consequence, no precise figures 
exist to describe DoD or other investment-fn these areas. 

A useful estimate can be derived, hewever, by noting that the FY 
1966 Defense budget for these categories of research is $1.39 billion. 
Using the generally accepted understanding that this investment had been 
growing at a rate of 8 to 10 percent per year, a total investment of 
$7.5 to $10 billion for the years 1945-1963 is calculated. A similar 
calculation suggests that non-DoD funding (including industry, state 
support of university research, and other Federal agencies' expendl- . 
tures) came to some $5-7 billion for the same period. These estimates 
are given primarily to demonstrate the absolute and rel'ative orders of 
magnitude of expenditures for research within the United States. (See 
Appendix E.) » 

For the 710 RXD Events investigated in detail, the distribut ion of 
funding sources was as follows: 


DoD direct funding- ----- — --85$ 

Defense-oriented industry - — - -- -- gjj 
Commercially oriented industry- — - - - 5$ 

Other Government agencies -------- ^ 

Universities (state or private funding} - >12 


The 85 percent directly funded by the DoD includes work supported by 
Lhc in-house laboratories of the Military Departments and all DoD con¬ 
tract and grant-supported work with any external organization. It does 
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not i nc I title work supported under t lie* ASPR-XV IReD Program, a funding pri 
cedure under which Defense contractors con recover some self-generated 
research expenses as on overhead cost against DoD contracts; nor does i 
include work funded by industry out of profits on DoD contracts and 
initiated for the purpose of gaining future contracts. 

Inclusion of the last-named categories suggests that, whereas the 
DoD only funded an estimated 55 to 65 percent of all on-going research 
in science and technology, 9** percent of the work that led to results 
useful in weapon systems was in the class directly or indirectly funded 
by the DoD. 

The principal conclusions that could be drawn from this, observatio 
are that DoD requirements aie in fact unique or that a tremendous dupii 
cation of effort was involved. To a certain extent the latter possibil 
ity is refuted by the findings discussed in section 4.3 regarding 
motivation for utilized research. 



Figure 11. Torpedo Mark 46 






Willi in a throe-sUinduitl-tlev i at loll limit, idenl i I icd cuMi ol UuD- 
lundod Events in the XI) category varied between a few hundred dolluis 
and $$80,000. The median Event cost was found to be approximate! y 
S'lV.OOO. Industrially funded Events for the sane class of research 
varied in cost between a few hundred dollars and $?!i0,000, with a median 
of about $33,000. So few RXD Events were funded by other sources that 
their analysis would be statistically unreliablo. 

In the two categories on which useful data exist, the conclusion can 
be drawn that, although the DoO can or will undertake far more expensive 
research tasks than industry, the median RXD-Evenl costs are quite com¬ 
parable. ^Accepting the estimate that there is a difference of less than 
a factor of 2 between total DoD and total non-DoD investment in research, 
this finding also suggests that the DoD funds a greater percentage of 
low-cost research than industry does. 

it.3 Third Strategy : Determine significant management and other 
environmental factors, as seen by the 
research scientist or engineer, that appear 
Lo be commensurate with high utilization of 
research results. 

4.3.1 Finding : the utilisation factor appears insensitive to 
classical differences in organisational structure or profit motivation 
appearing between U.S. industry, in-house DoD laboratories, and univer- 
sity-atisociatcd science and technology centers. It may, however, be 
sensitive to differences between these types of organization and the 
.tLissia organizational structure of universities. 

Within these three major organizational types, the distribution of 
RXD Events was found to be that shown in column 1 of Table V. The true 
measure of relative productivity of these three organizational divisions 
would require that the distribution of RXD Events be compared with the 
funds available for research in science and technology in the same time 
period. While data of this type are not available, or are not known to 
exist in useful fornij a less rigorous measure of funding correspondence 
may be developed. 

First, over 9i percent of the RXD Events can be described within 
the National Science Foundation's "applied research" category; NSF esti¬ 
mates of DoD fund distribution* by type of performing agency, from 1963 
to FY 1966 are shown in column 2 of Table V. A second measure of the 
distribution of funds is available directly from the data gathered under 
Project HINDSIGHT. Percentages of the total cost of identified RXD 
Events appear in column 3 of Table V—again, classified by performing 
agency. 
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I lie UK)-, t i mini- cl i »i t <-■ ubMlv.ilion III l>.- iiuiclr I i urn l.ihli- V i-. if.r clo-.r 
<.h rel.it ion Lit- tween RXL> Ivi-nl amt I muling d i-, l ri but i ore, 'lot bwtli .tv.ii I- 
able onil expended fiiml per- ont i les , .is calculated in column-. ft ;ni<l 'j . 

Tin- i.ilio*, vary only slightly t ro;n but- oigarii/at ion type; > ( > unuthi-r, 
portly subst jut i at in-.| tin- Ijndiny. 1 he NSF esl ironies lot cun- 

not be expected u> represent the diyt ribut inn of fundi over the previous 
18-ye.w period; however, they provide a useful fi rst-order approxim.it ion. 

It iv the nature of research that dollar amounts convert readily to 
scientific and engineering man-years, and this allows a second approach 
to the finding. The total national population of scientists roughly 
quadrupled during the period from i9^*5 to I9&3. while the same population 
segment in the DoD laboratories is believed hot even to have doubled. If 
the finding is valid, therefore, the DoD laboratories should show a gen¬ 
eral decline by a factor of approximately 2 in the of RXD 

Events generated in-house and an.increase by thesame factor for the 
..vVvi.-if.’ number generated. Figure 12 displays the time trend of DoD in- 
house RXD Events, showing very nearly the exact results expected. 

Available funding data for universities do no* permit an analysis of 
the relative product! vi ty of two groups of research scientists--those 
associated primarily with the educational portion of the University and 
those associated with the scientific and technological centers- Such 
centers as the Lawrence Radiation Laboratory of the University of Cali¬ 
fornia, the Jet Propulsion Laboratory of the California Institute of 
Technology, and the Instrumentation Laboratory of the Massachusetts 
Institute of Technology are currently receiving an amount estimated at 
less than 25 percent of all funds for basic and applied research going 
to the enti re .universi ty class—-and, of this, perhaps 60 percent is for 
applied research. Comparatively recent increases it. the size and number 
of these groups suggest that’their earlier funding was even less. Thus, 
it is significant to find that 75 percent of the university-credited 
RXD Events came from associated science and technology centers or arose 
out of recognizably mission-oriented programs. 

Within the correlation accuracy of the sets of figures cited and 
modified by the discussions, it is concluded that the utilization of 
research results is essentially insensitive to differences in classic 
organizational structure that may appear in U.S. industry, In-house 
Defense laboratories, and university-associated science and technology 
centers. The finding cannot be extended to include the educational 
portion of a university. 
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hi tin* extent peiniilUu! Iiy the .Ku*v.il>i 11 ty «1 [lie u-M.inii 
rmer ami tlie validity ol his recall , itilotmti ion w,i*. sought rey.ii «t,n 
s ordinal «m>t iv.H ion. levs Hutu. V |M*rcent ol the RX|! Ivenis i l«e.-,t 
od researt.li in science—lii.it. is , less than ont-luill itf I P'-' < «*nl 
ie total—appear to have come about because the |>e r I’m liter was inlet 
ted primarily in extending the bounds of knowledge. In ‘Jo percent n 
,e scientifically oriented Event;.., the scientist appears to have been 
itivoted chiefly by his awareness that an actual problem existed. 


For this particular analysis, a distiiiclion was made, not between 

basic and applied research in science, but between undirected l by •»'< 
aqency external to the performer) and mission-oriented research. The 
criteria for classification included the requirement that the perform¬ 
ance be associated with an identifiable generic problem rather than some 
vague possible utility of the result. Thus the data arc considered 
reasonably representative of the situation. 


The distribution within the mission-oriented 98 percent shows that 
73 percent was funded by the DOD, 19 percent by industry, and 8 percent 
by other Federal agencies or by foreign governments. Within the 73 per¬ 
cent funded by the DoD, 21 percent of the work was done as part of an 
organised program at a university-operated science and technology center, 
12 percent as a separately funded project at a university, and 38 percen. 
at in-house DoD laboratories; and Lhe remaining 29 percent was done by 


industry. 


It is emphasized that the total sample size of scientific Events .is 
so small that the subclass distributions showh above must be recognized 
as being only roughly indicative of the actual situation. The only con¬ 
clusion that can be drawn with a reasonable degree of confidence, there¬ 
fore, is that most research in science whose results were found to have 
been used in weapon systems was undertaken as part of an organized pro¬ 
gram. Specifically, most utilized new scientific information came from 
organized research programs undertaken In response to recognized Defense 
problems. 

4.3,3 Finding : As a rule, the most useful role'of science has 
been that of providing phenomenological explanations to the engineer. 


In all the systems studied, there were only two cases where recent 
research in science suggested to the engineering community a genetically 
or fundamentally different way of reaching an objective. Those cases 
involved the introduction of (1) the transistor and other solid-state 
devices and (2) the thermal battery. The other scientific contributions 
were markedly similar in concept. The scientist, by gaining a reasonably 
thorough understanding of a process, technique or phenomenon used by an 
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In ,i •.i'll-.i-, lliis "mii|i ii|i" lull* ill • iVsr.il ih in M h-ntf tli-.Mi il«“ t>‘j 
pt-urnl i*l tlu* • i ii*iit it ii.iliy ui ii*nti*il lvents. Iikiiu fuse w.i*. tin* n - 
iv.iilIi ill sciriuv ill i riled toward l In* si. I ul inn ul .1 i I it problem fur 

a pai l iriilnt system. Invul ialily. tin* siienlisi looked al general problem*. 
Ii>* in'. 1 aini*, an invest iqrfl inn ul itlie signal and noise (.liat'wi lei is I i 1 *. 
ol outgoing and returning radar |nil*.(*s li*d lo l lie i-.tabl islint.'iil of lil'i-l 
theory, and t lie eng i neer, applying .that l.liet.riy, developed a greatly im- 


This example alsoitolps deli lie the difference alleged in llie iniiiiedi- 
alely preceding paragraphs. The fundamental capability of delecting or 
locating 0 target with radio energy was not ! a consequence of recent, re¬ 
search in science. The scientist, observing the radar set in action, 
devised a means of■improving its performance, and in this regard science 
followed technology. Within this definition, 69 percent of the research 
in science studied by Project HINDSIGHT served to provide useful phenom¬ 
enological explanations to the engineer.. 

'*»-3. Finding : ¥'//«.- VH ! //ur. , i>*)* uppoarn to vohi lu-avily on uui.j'it *.; 

;//,* inoorii atui tabu Uited roiaiilific 'btformt-ion nubtirJtx -:.in 
thym'tuj-.ia!-,) luvulbookr. ,xn,i U sc? wJ‘(.*»s.*»k.s*». 

Because there was a paucity of Events specifically oriented toward 
science, yef i t was recognized that many of the technologically oriented 
Events showed contributions from science, a deliberate attempt was made 
to reconcile this apparent discrepancy through a sampling analysis. The 
results of this effort are best described by the following statement: 

The average performer of the XD Event demonstrated a high 1 level of under 
standing of, and general famiIiarity with, uni fled theory. 

The initial observation was that the engineer usually relies upon 
such scientific knowledge as Maxwell's equations. Ohm's law, the Nyquist 
stability criterion, Boyle's laws of gas dynamics; and Newton's laws. 

It would appear that the engineer remembers and uses algebraic expres¬ 
sions, general solutions to differential equations, or simple graphical 
techniques that he encountered in col’ege, but does not seem concerned 
with the details of the underlying theory. 

Thus it is the form in which scientific knowledge is made aval I able 
to the engineer, rather than other characteristics such as the age of tin 
knowledge, that is important. A similar conclusion regarding the most 
useful form of scientific knowledge is drawn from ah observation that 
i.hc engineer uses, as typical text references, the results of scientific 
or techno logical research that have been condensed and presented in i n*, i 
ly handled tabular or graphical form. 
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(Ivan I U, W.llai* !.'«•, iilV-.l jnqhuii-.f, m-In-.I lu-ayi.ly mi Kr •tit,»».«( 

n wnmat whal w.is known about sihohiI.ii y emission hi I r.nr.inis*. 

stoning with the work af iciin.iiit in l*J00 .slid terminal imi will, ih.it «l 
5. Wecker in 1941-despite Hie 1.111 lliat Goel/e hintseir was i'fani iI:«-.l 
Inr Liter work in this aiea (heli*-eii 1%4 and t%f»). 

Similarly, the designers til the sirIp-1 irie-cnnficjurcd . omporn-nl y of ' 
the tr.insmitter awl frequency synthesizer subsystems at lit*- AM/SI’S-4 B 
radar credit the Hindi.\4 . «J* Tri-/ /.(in <1/. >.a t.v **, pub I islnd 

in 1956, as having been one of their principal Uv.tmic.il-informat iun 
sources. This handbook brings together, in p form useful to the engi¬ 
neer, the stale of the art nf fnbricatiun techniques involving selection 
of dielectric and metallic materials, bonding of metal's to dielectrics, 
phoioelching techniques and packaging of component assemblies. Among 
the designs suggested are transformers, wave-guide and coaxial transi¬ 
tions, terminations, attenuators, variable timers, detector mounts* 
power diodes, hybrid rings, directional couplers, filiorsand antennas. 

In brief, this designer's guide offers basic techniques and practical, 
approaches to the design, fabrication, measurement and assembly of the 
most advanced strip-line devices for microwave transmission. 

Such observations suggest that more new scientific findings would 
be used -in weapon systems if research managers were more concerned about 
the form in which the new information is made available to engineers. 

4.3.5 , Finding : .moot utilized nan tephnologieut information was 
generated in the process of solving problems identified in advanced or 
engineering development of weapon systems or in advancing the state of 
the art of generic technologies commonly associated with broad classes 
of weapon ay stems. 

Motivation of the performers of research in technology can be clas¬ 
sified in three broad categories: 

(1) The objective was a requirement of a specific system or 
end-item device; 

(2) The objective was to satisfy a recognized generic techno¬ 
logical requirement; or 

(3) There was no identifiable objective other than the desire 
to forward the state of the art. 

Events falling into the first category are readily discernible. 

Far greater difficulty was usually encountered in separating the second 
and third categories. Judgments were necessary concerning what authority 
could "recognize" a requirement, how to define a "generic" requirement. 
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0| .ill KXD ivi-nt-., 61 puiienl li.stl u -i |>i*c it it sy.lrm i r'Ji.i i i i-ifn-i'i! .i'v 
.III ill. ji-i i ivo. flu- 61 pen i-iit ilivilli'll into (a) 20 pi in-nt ih.il l.a'I as an 
olijViliye ,i‘ i cqu i lonifii t i". tab I i shed by mu: nl the weapon sysi i-ms stiidiirri 
in Pioifsi HINDSIGHT and (l>) AI percent lh.il were inUH.di-d 16 satisly .. 
ie.pii i iMiiiMit in 'sunk’ other sys tem or oppl ic.it ion. 

Clearly, in ?/ percent of the KXD Events, the idemilied objcct ivi¬ 
ol the research effort was the satisfaction of a generic technological 
reijui rement. In a few cases, particularly when the Event involved a 
iiMleri.il s or a "T.ibrical ion process, the results of the research were, 
found to have been appl ied to material:, or applications oilier than those 
considered by the research performer, for example, the vacuum-arc- 
smelling techniques developed for titanium and uranium were applied al¬ 
most directly to Steel production, and the plosina-depos i t techniques de¬ 
veloped for .meto 1 -piat ing found use in the deposit ing of refractory 
materials, the number of identified examples exhibiting this transfer 
characteristic, however, was not big enough to warrant a statistical 
breakout. 

In the remaining 12 percent of RXD Events,.the motivation was: 

(1) a commercial end item, 

(2) basic research or 

(3) indeterminate (usually for the reason described above). 

(*•3.6 Finding : The program of research in technology oriented 
specific types of equipment has been a particularly successful 
approach to generating utilized knowledge. 

This finding examines a noteworthy portion of finding 4.3.$. Cer¬ 
tain projects or programs supported by the Military Departments were 
repeatedly credited wl.tn having been the source of scientif ic or techno¬ 
logical knowledge used in other weapon systems. Principal among these 
Were the Army's Missile A and Missile B programs, the Navy's long-range 
mine and RETORC (research torpedo configuration) programs, and the Air 
Force's NAVAHO missile program. 

The common characteristics of each of these included the specificity 
of the program's operational goals and the freedom granted to performers 
to explore multiple approaches to the solution of problems identified 
throughout the program. With the exception of the NAVAHO program, none 
was intended to deliver a particular operational system at a-given time. 
In-every case management was centralized, and apparently was able to 
maintain a practical degree of balance among the diverse scientific dis¬ 
ciplines and areas of technology in which further work was necessary. 
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1)1*11.*i',l I l.tHR Uts inn 111 lh> llMMIl lll«' llli* IUM |Jl.»>t*;*»iiluj ! i»l 0 il,fj*. i*. 
that weapon sysl.'in*. prosviit iliiit|Ut* tlunuml*. upon lIn- lol.it Ici liiio Inq it.uI 
potential — unit)«u> in tin* •■rust* lh.it lln-y lamiot In* vji i*,f it «1 by' 1 lie lut.li* 
m>liu)v developed lor t o:tm*i i i.il piii|ni*,e.*.. Ihl*. t uni I u*. i<>n .*|il.iiir,tbe 
14o't i-i**. *• o 1 tin* al01 omen t inned pnuji.iros, • 

j Win- iv llu* ii|)plii.,it ion of 'iiit'iiu* or t ei.linoloijY i*. limited, qtea'iur 
spot i Tic ity in defining objective*. is essential. Within tin* curjcrit 
capabilities of planning nu* tI hhIs, this appears to In* most readily ..it.i.oiu- 
p I is lu*J 1I1 rout|l 1 quantitative description of known'"real-world" problem*.. 
Actually, as well as in concept, the user of weapon systems must estab¬ 
lish a dialog with the scientific' and technological cumuiuni! ies . in which 
agreement is sought concerning the minimum operational c.upabi lily.tn.it- 
would be worth buying for a giv*n price and the maximum operational cap¬ 
ability that can be afforded at the price with forecast technology. 

When agreement is reached—and here the discussion is limited to 
systems that are Weil beyond the contemporary state of the art—a delib¬ 
erately advanced development program may be undertaken. Detailed designs 
of several potential solutions to the overall system problem can be pre¬ 
pared. The designs then provide the focus for a supporting research pro¬ 
gram. As long as the operational objectives agreed upon at the outset 
are not compromised, the scientist and technologist can have the freedom 
of design flexibiIity to allow other technological compromises. Alter¬ 
native approaches to original design are essential in order to minimize 
risk and, at this state of the R£D cycle, are relatively inexpensive. 
"Metal bending," or the commitment to hardware, is essential only to the 
extent that interface problems can be highlighted and identified. 

The value of focused program planning in science and technology is 
most strongly supported by examination of the NAVAHO program. Contempo¬ 
rary guidance and propulsion technologies, to name just two, were com¬ 
plete,ly inadequate to provide the first-phase NAVAHO missile, which had 
a minimum range of 30Q nautical miles. Although inertial", radio-inertial 
radio' and celestjal-inertial guidance techniques held promise, no ap¬ 
proach guaranteed success. Further, the different guidance approaches 
placed dissimilar requirements on the missile's flight prof lie—anywhere 
from essentially constant-altitude aerodynamic to fully bal1istic—which 
in turn established requirements for considerably different rocket or jet 
engines, none of which were within the state of the art. In a similar 
vein, dependency variable requirements were established for .other parts 
of the airframe and ground support equipment. 

The Air Force approach to this interplay of requirements was to 
provide specific but very generous scientific and technological objec¬ 
tives, and the relevancy of the science and technology generated by the 
NAVAHO program to other Defense problems is fully attested to by the 
widespread use of the new knowledge. 
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liu 1 -.loiy i>l llw A» my * *> Mi'.silc A .iiiil Miv.ili - H piogfoms i >. quite 
iniiKu. liie i e-.ii 11 •• uyi »•;: iiian i I I eil in .H le.ivl the l AMU Hii'.'.ilr ’.y*.- 
loin .mil very likely in olln-i system 1 , mil yet si tidied iiy I* i ujVc t HINIj 
S llilll. Another .idviinl.iije ul -i Iype-equipment-01icntod in.nuqiMKMit is 
ileiiK'ns luit eil in Figure I*, ilie i.ln unoloqy ul l vents' leading to ilie M.iil 
‘>6 .iiul V/ mines. C I ear 1 y the. te (.Imo.lugy was developed in un ordet ly 
tu>iiioii,. e,s soil l ial ly ul f'the -f equi s ite knowledge being jv.ii table beioir 
i l w.is needed in t lie end i I eiii. 

Another indicator of the value of focused program planning in sci¬ 
ence ami technology is provided through anjly/ing the rule: ul knowledge 
accretion.' For this purpose the studied systems were divided into two 



(1) Those that went through a relatively extended prepreto- 
type and prototype development path—or, at least, for which a system- 
concept approach was adopted in the formulation of research and explo-. 
ratory-development programs; and 

(2) Those that were developed in an essentially one-step 
process, front technology base to final system configuration. 

Typical examples are the Mark 56 and 57 mines (Figure *1) for the 
first and jthe LANCE miss)le system (Figure 3) for the second. 

All RXD Events associated with each system within the two classes 
were analyzed to determine when they had occurred, in terms of how long 
before or after the system's engineering development began. The re¬ 
sulting data were displayed as in Figure 13, The potential advantage 
of using an end-5tern-oriented, systems-analysis approach in formulating 
long-range programs of science and technology is clearly seen. 

The title of Figure 1.3, "Technical Confidence Level," was chosen to 
point up another advantage of focused planning. The RXD Event is gen¬ 
erally associated with a scientific or technical problem (see finding 
4.3.2). Thus Figure 13 suggests that there are typically three times as 
many unsolved problems at the start,of engineering development when the 
preceding research programs in science and technology had not been the 
subject of focused planning, if it is assumed that the probability of 
finding timely, acceptable solutions to these problems follows a Gaussian 
distribution, the relative technical risk is nqt 3:1 but the Naperian 
anti logari thm of 3, that is, 20:1. 

In retrospect, some reasons the weapon-system approach to research 
planning should be profitable are obvious. Coupling the research and 
applications-engineering communities is the natural consequence of the 
process rather than an afterthought. By being responsive to the identi¬ 
fied needs of the applications engineer, the research community's in¬ 
terests are focused in common with those of the marketplace for research 
products. 
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UIKkTljkO'l U-. • K’liefic IVSlMld) (I'tlldilKJ k.i.l,) ,.ituppi:,lr:> 11101 
Itolp is ,>11,Mod by ilu» finding lhot Milmu; is a very high correlat ion 
between ul 1 I i.-jlion ol research results and the fact that the user had 
first staled the problem. Certainly it suggests that the uselul .juthoi- 
ily lor defining a requirement is, in most cases, the applications 

Although applications engineers suggested the problem toward which 
research was directed in over 85 percent of the Events in technology, 
the technical initiative in proffering the solution in 72 percent of 
those Events came front the group performing the research. In the re¬ 
maining 28 percent, technical initiative resided in the apptications- 
engi nee ring group or was shared by both groups—or the information was 
not available. The dominance of the cases in which technical initiative 
was taken by the performing group is so overwhelming arid the data con¬ 
cerning the remaining cases are so indefinite that further resolution 
appears to be pointless. The characteristics of the performers are 
considered in section 5. 

During the pilot studies preceding those of Project HINDSIGHT, it 
was noted that successful performers—in the sense that they achieved 
utilized results—were equal ly successful in quickly obtaining necessary 
funds and other capital resources. Because this quick funding appeared 
to be atypical of DoD research support, it was suspected that the obser¬ 
vation was significant; consequently, a deliberate effort was made durin 
the Task I studies to gain quantitative information on funding delays. 
The results of this effort were not satisfactory. In very few cases 
was there such a delay in funding that the performers remembered and 
mentioned it—or this may be the consequence of a selective recall 
difficulty.. 

The Tusk ii study personnel are continuing to examine this matter. 
Subject to what would now constitute a surprising finding by the Task II 
team, it should be concluded that, to achieve a high research payoff, 
timely accessibility of cap!taT resources is equal in importance to the 
recognition of a need and the existence of a source of ideas, together 
with the. communication coupling between idea generators and users. 








HinliiHf <*.4./ il i s< fused lh.it t hr I f.iMt (. ti-ul il i/.il ion luiloi w.i*. 
tiii|h when the i« .It inns i'iK| iiii'i'i (•',t.ihl i'.lu-tl tIn- • i-.f.irLli «jh]in 1 iw*-. 

Ini the fu'i qioup. lhis imptii-, tin* umcomi lunl ox i *, I i*m.e ul 

quint iinuminii.it btMwH-n tin* lwn yiwips. Available data tlc> not de 
si i iIn' tlu- iol.it ive iiequoniy with wliiih .my of tin* sm-rul possible. 
..miiminii.it ions links art* used lot indicating requi reim-nts. But the do t a 
du present .» p.itteru with regu i tl to toramunit .it Ions in the opposite d i t ei.- 
tiun, th.it is, Che p.issilH) of lesedri.li lesuits toward the eventual user. 

ruble VI shows the findings in terms of the Severn I classes of re¬ 
search or exploratory development previously described, and considers 
three general classes of communicat ions links: the informal person-to- 
person contact, the puhlisited scientific or technical report, and the 
professional seminar or symposium. 


Table VI. MODES OF IDEA TRANSFER 


RXD cateqory 

"Ters"ondl 
contact (2) 

Publication 
or report (2) 

Seminar or 
symposium (2) 

Research (R) 

45 

53 

2 

Exploratory development: 
XO 

64 

33 

3 ' 

XD (design) 

79 

21 

0 

XO (mfq.) 

77 

23 

0 


Note: Figures are percentiles of the research class (horizontal rows). 


Despite the fact that the professional meeting embodies seme of the 
characteristics of both the other links—generally a published technical 
report is presented, and there is at least an opportunity for person-to- 
person interaction—it is seen to be the least often cited. Publication 
is clearly the dominant mode for the transfer of scientific Information, 
with a transition toward Informal, person-to-person communication as the 
specificity of the technological Information increases. 

It should be noted that the data presented in Table VI consider 
only one attribute of the seminar or symposium. The true worth of these 
meetings is not measured, principally because we cannot establish how 
many valuable personal contacts resulted from encounters at such meetings. 

Gilmore, Gould and others studied the flow channels of technical 
information utilized in commercial firms. The results they have reported 
corroborate several of the findings of Project HINDSIGHT. h 

r, John S, Gilmore, William S. Gould, ei ai., The Cha'.hds cf 
> t oLoju fia{ulsition in Ccmnuivial Fima atvl the hYu'A .'''ni<i xt :c; 

Pro- (Denver, Colorado: Denver Research Institute, NASA CR-790, June 
1967). 


48 






1 



i tin.- l.iiqi- U'(hni(.<il im-e l i ng-., tlu-y ■ 


Convent iciftv, conferences, symposia, ami I ratio si 
highly ranked channels > ,\>l much J\‘r I heir j\ 'i 

'1:.•>; .,".»/• tv .is lor lho opportunity l» 
exeh.mijv i lit orm.lt km with col leagues and to Iiisj 
product displays. Many individuals questioned i 
that torm.il papers presented at meetings tended 
serve the interests of the speaker (by boost ilit] 
and that r'eu i red! In failed Lo intitule prepr. 
n'.ri -ful i (Italics added. J' 


■ Research Instilute group further reports that: 


Textbooks and handbooks tend to be from two to five years 
.’>■ behind the state-of-the-art. Nevertheless, they 
were one of the most important sources of information for 
problem solving. 1 ’ [Italics added.] 


The words, "or more," are emphasized here because, during the HINDSIGHT 
information-collecting phase, it was repeatedly observed that a substan¬ 
tial number of the most frequently used text references were 15 or more 
years old. 


4.3.9 Finding : The evidence denies the coimonly accepted hypoth¬ 
esis tint relatively few organizations provide the majority of the 
utilised nets science and technology. 


An analysis of the distribution of RXD Events and their rate of 
production according to performing organization reveals two principal 
features: Over half the identified participating organizations produced 
only one RXD Event, and over 70 percent contributed less than three. In 
the low-rate mode, the industrial laboratory.was predominant, and as the 
rate of Event production increases the principal organizational contribu¬ 
tor shifts steadily to the in-house DoD laboratory. 


Table VII illustrates the process and shows that, when RXD Events 
per organization reach four or more, the DoD laboratory becomes a domi¬ 
nant source. 


These findings are entirely commensurate With those cited earlier 
regarding the significant modes of information transfer, and they illus¬ 
trate the obvious conclusion that It is easier to communicate technolog¬ 
ical requirements within a single organization, the DoD laboratory re¬ 
sponsible for the system development, than to disseminate the require¬ 
ments throughout a widely scattered industrial community. 


‘‘Thid. , p. 25- 
h Ibis.i. , p. 26. 
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In huu-.f linlJ infill",!.»• I *»«i vi*» *. i»ii*».* 

Number i«l I yon I •, 1 iilnn a Lury ( ) lutmr.itory ( } () 

our w ii 

fw«> or imiri* 31 Mi . n 

Four or more Jb b? . \V 

Six or more bO Vi ?1 

light, or more <[\> lb lb 

1 on or more JiU ?» ' V> 

Notos: riguros ar.o poruontilos of Ihr rate rl.r,s (horiVurita 1 njw r »). 

* Inc Imlos sciinure ami technology cottiers. 

Four lb SI ro logy : If I lie findings of tin- llisi •.Ir.ilerjy indicate a 

significant reliant** cm now science.' or technology, 
devi se a y.ilue-cost index (or set of indices) 
which offers u uuuiiiiieilivi- measure of the reluin 
on investment in research, in terms of the en¬ 
hanced cpsi-eflecliveness of the weapon system-, 
made-possible by the purchased knowledge. 

The fiiulinys relevant to this strategy clearly demonstrate the re¬ 
liance of new weapon systems upon the results.of research in science or 
technology to achieve an improved cost-effectiveness ratio. Section I 
ot this report, "Requisite Level of lnvest..ient in Research," gives sonic 
gross estimates of the relationship between the cost of research and the 
value received; but a more useful, precise, quantitative indicator for 
describing the effectiveness of investment in research has not yet been 
devised. 

The studies made thus far offer some insight into- the factors to be 
considered in an equation relating cost and value. The effort to devise 
the cost-value index (or indices) should continue. 

'.M*,I Finding : Multiple user, of scientific and Utttl,u>lo-jlo.jl ad¬ 
vances xii-hiii a multiplicity of weapon taunts require eitiuir Vnai uu 
revean.'k investment east be apportioned amour ail utilizing dsye'emo or 
ttuit a portion of the total value added u y each utilizing system tv 
attributed to the identified Kvent. 

A given RXD Event may manifest itself one or more times Si\ a single 
weapon system, and it may contribute to an increased cost-effeciiveness 
ratio in one or more systems. Considering only the 20 systems that pro¬ 
vide the data basis of this report, at least 20 percent of the 710 Events 
were identified through more than one system. During the course of the 
investigations it was frequently learned that the knowledge accruing from 
an Event had been used in systems other than the 20 under study, In 
fact, it is believed that, at the time of the study, over 80 percent of 
the P.XD Events had contributed to three or more applications aside from 
those in the study. 
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This finding (also discussed in relationship to the first strategy), 
considered witli the recognized multiple use of a given Event, shows that 
only a gross approach (i.e., considering the total cost of all relevant 
research) will be meaningful. Further, if all research costs arc to be 
included, the ..value-received side of the equal ion must take into account 
all Weapon Systems that use any part of the new science or technology. 
This introduces the notion that value must be computed In terms of the 
weapon-systems mix rather than a mean or median cost-effectiveness ratio; 
and the problem of assessing the cost-value relationship in research be¬ 
comes a matter of operations research, rather than accounting. 

A.5 Specific Challedges Establish the significance of specific 

Regarding DoD questions or challenges raised by critics 

Management ; of the DoD research programs. 

The derivation of such challenges is described in the introduction 
to this report. In this section, pertinent findings are discussed in 
terms of the challenges, which again are presented in the form of hypoth¬ 
eses; • 




A.b. I first dial t enyf; Tin* Dot! 1 *. rvqtiirt , im*nl*. fur iiiiurinal inn 
in science anil technology can be sat i<.l led (o such an 
extent by research supported by the National Aeronautics 
and Space Administration and the National Sc ietn.e Founda¬ 
tion that significant reductions can be made in tin* 
applicable port ions of the Defense budget. 

F imli ih) : .Aw/fwim/'/srW/ia: t rj‘M,*i» ,*!i><,7i,s- is* fe-*/r»it'«'-w/;r 

UiU.i ;k '.r/s*c* o.y.-rftir/ri uUv lin• vrtutll. of nd'-JV’/Mr;.-*. / »*»Yx/M//rr.t. 

Less than 2 percent of DoD-uliHzcd research rcsults, both scien¬ 
tific and technological, came from programs supported by other Federal 
agencies, state governments and foreign governments. This is not sur¬ 
prising in the light of the finding that 61 percent of the RXD Events 
occurred as the result of a specific technological weapon-system require¬ 
ment, and that 27 percent were the result of research conducted to sat¬ 
isfy recognized generic technological requirements of broad classes of 
weapon systems. Of the remaining 12 percent of Events, 9 percent were 
the result of scientific research, most of which was oriented toward 
Defense problems; and 3 percent were for the solution of commercial prob- 
I ems. 

Relatively little undirected research (as defined in Table IN) Is 
in fact sponsored by the DoD. The larger part was found to be very 
relevant to mission and therefore 1 Ikely to be of primary value to users 
having quite similar requirements. 

During 19^*6> the starting'point of the period studied by Project 
HINDSIGHT, the Military Departments invested about $115 million in the 
categories considered here as RXD. At that time the investment by other 
Federal departments was negligible. As noted In Appendix F, military 
spending increased steadily and gradually to $1.5 bill ion in 19$3< Com¬ 
paratively significant funding In these areas by other Federal depart¬ 
ments or by Industry did not appear until late in the 1950s. Their 
expenditure rates increased more rapidly than the DoD's, so that by 1963 
the other Federal agencies were spending about $6.3 billion on scientific 
and technical investigations, and industry, about $2.1 billion. As a 
result, for the entire period from 19h5 to 1963, the DoD spent altogether 
about $10 billion; non-Defense expenditures for those years totaled $6 
bill ion. 

. If the process of technological growth were truly random—that is, 
independent of users' requirements—Project HINDSIGHT should have found 
that a much higher percentage of RXD Events were funded by non-Defense 
organizations. Because of differences In starting time and growth rate 
of the two funding categories, a ratio of 60 to 40 percent would not be 
likely, but it would be closer than the observed 94 to 6 percent. 

This discussion and the ratios suggested relate to all funding 
sources other than DoD, rather than to the other Federal agencies alone. 
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While ii i ■. .1 tli'i'.ii tun* I nun tin* Liiii- inlt-nt i>l I In; liyput hr*. i *., t In- iliv 
I'11-.S i i Hi pn.vi.lr-. .1 _l.rll.-r (.mil -.(ill i nt1 I ,-i II I y i mis i ‘. I i-n I ) l.,.*.i*. 
toi .iii.i lysis. Il ili-moii-. 11.Hi--, th.it tin- wont-, -.limnr .mil it-tlmology ore 
i anvi-ii i i-n l .irl if in-*.. In l.ii I, il would In- moi i n-.ili-.tii to >,pi-.jk i.t 
the: hi. my scionrtv. .uni ti-ihiiolnqir-. llu- put t icul.u l ii-ld <;l \t. irm_e or 
li*cli|ii)loijy lli.it i-. iiii|)iu uni to .my user tuvil hour no '.imilutily lo lh.it 
of .motlit*r u*.i.-r, but -.ncii-ty for convent etu.r ho*, .ulopti-d ifio'.i- word 1 , o', 
generic tomis lo signify the iiuny si_iein.es .mil technologies llius c.tle- 
i|oi i/eif. 

Thus, .a I though both Defense .mil NASA m.iy be siiid lo conduct scien¬ 
tific.; jtid 'Icbliiiical/'.l.livsi'stig.il (pits in .hi area lermed rocket propulsion, 
lor example, il catin6i.be concluded that their work is duplicative- ui 
even usefully comp lenientary. Onemight suspect that, as long os NASA is 
interested in cislunar exploration, the related equipment and propulsion 
technologies will be gui le sinti lar to those associated with the DoD's 
sate 11ile and I CBM systems. Clearly, however, there will be a technolog¬ 
ical divergence, where NASA's interest extends beyond the cislunar into 
regions in which magnetohydrodynamic and ion propulsion systems are 
practical. Similar trends can be expected in communications and perhaps 
in Materials, only generic names rfemaining in common. 

The conclusion is that even greatly increased expenditures for 
scientific and technical investigations by Federal agencies other than 
the DoD are unlikely to result in satisfying many Defense needs. 

'1.5.2 Second challenge: The currently high-level support 
of basic work is producing scientific and techno¬ 
logical infoniiation at such a rate that it cannot be 
effectively digested, interpreted, disseminated or 
put to practical use. 

Finding : The available information is being adequately 
rroaiaast but is insufficient, despite the level of expenditures, to 
satisfy alt requirements. 

Were this allegation true to any significant extent, there would be 
a very low probability that the result of any given research effort 
would have many uses in different weapon systems. In fact, over 80 per¬ 
cent of the RXD Events are believed to have contributed to three or more 
different weapon systems, and those systems generally were developed by 
different engineering teams. 

Figure 14 summarizes the tiiiie distribution of the utilized RXD 
Events shown in Figures 1 through.11. The data have been normalized to 
the dates of system design, engineering development, or first production 
contract. Approximately 33 percent of the requisite new sclentific and 
technological information is seen to have been generated after the nor¬ 
malizing date, and to a considerable degree was paid for with engineer¬ 
ing-development money. 
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in this chill longer tlu“ of fuel ivoni-ss ol l ho muntiguiiiorit vxi-rt'i sue) |,y 
the OoD over thi- mi I i Uny-sci uncus budget colvgor'y is queVl iejned, vi: 

ImproVdJ nianuguiriunt am* critical si*loci ion procedures such 
os' those which are being appl iod ‘ ti> complex-and cosily 
wopon systems could well and profitably be extended to 
the supporting efforts included in the "Mi Iitary Sciences" 

■ category. \ • . 

Generallythe synergistic consequence of hundreds of identifiable 
advances is the basis for a markedly superior weapon system, rather 
than one, two or three important scientific or technological contribu¬ 
te order to apply a cost-effectiveness approach, it would be nec¬ 
essary to desc.ribe fully each combination of advances that could permit 
d future system, and then compaie the combinations. The task would be 
further complicated by the multiple-use potential of the individual re¬ 
search effort. The "shopping lists" for ail considered weapon systems 
would have to be compared before the most "cost-effective" research pro¬ 
gram could be determined. It is suspected that the expense of such a 
procedure would exceed the anticipated savings, while the time required 
would cause irreparable damage to the program. 

A possible alternative approach would be the development of analyt- 
•ica> procedures to aid In allocating resources among specific tecnnolo- 
gies that arc;important to Defense. The feasibi1ity of such an approach 
is suggested by the finding that certain technologies appear to be unique 
to the DoO. It is reasonable to expect that the military services could 
identify and rate their future requi red operational capabilities, that 
those capabilities could be reexpressed in terms of future desired mili¬ 
tary equipments, and that scientific and technological advances to enable 
developing those equipments could be identified. Thun, it should be 
possible to introduce economic marginal-return analyses to assist in 
decisions on resource allocation. ■ : 
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Dt>s it) n iny suth a procvduio appears to Ih* within tin* i.u» rent Mule 
of the m.iinigemen t jr t. Its implementat ion won I d be gem-rally tons i stent 
wilh t lie Project HI NOSIGH I findings in regard to Hi*, selection of «•- 
search tasks. 

Undoubtedly, in an activity us. Inrye i»>. the DoD's research prog l am, 
there are some marginal tusks. At best, the suggested munayement ap¬ 
proach could eliminate some of them, at the same time introducing a risk 
suggested by the following finding. 

k.5.3.2 Finding : .-I tti.jnif leant mwil'er ,<f 0 , rti impir: ;>:i 
it eer.tritui lew. e%me J'twi itonivivr at her than e* wtf. ■»•//.« •rhriij 

exp-vis. 

The investigation of a sampling of the RXD Events discloses a 
fairly common pattern. Both,the producers of the utilized scientific 
effort and their contemporary peers were aware of the avenues of explo¬ 
ration that the others were taking. The disagreement by contemporary 
authority as to the meriL of the approach that eventually found use was 
so marked that the successful performer broke with his peer group and 
secured new funding. More than anything else, these examples point out 
the necessity for ensuring competition within bureaucracy and the abso¬ 
lute essentiality of maintaining decentralized funding authority, or a 
multiplicity of funding sources, for every scientific discipline and 
area of technology. The challenge suggests a diametrically opposed move. 

As a result of decentralized planning throughout the time frame 
considered by Project HINDSIGHT, 67 percent of the requisite new knowl¬ 
edge was available before it was needed. Since it is recognized that 
the saving to the nation as a consequence of this new knowledge exceeds 
by orders of magnitude the total cost of the research program (see sec¬ 
tion 7), the real measure of the effectiveness of research management is 
the degree to which new knowledge is available when needed. 

It, 5.4 Fourth chal lenge : Significant portions of the 
Defense research program may be operating at or 
near a point of marginal returns. 

The analysis presented in this report is based in 710 RXD Events 
identified by studying 29 weapon systems. It is estimated that a more 
exhaustive study of only those systems would have revealed an additional 
400 to 1000 Events. The median cost of an RXD Event was $I|5,000. An 
average additional cost factor of 15 was found necessary to carry the 
median Event from initial demonstration of feasibility to readiness for 
application. 

Recognizing the weakness of these figures for anything more than 
order-of-magnitude estimates, and assuming that there were only 1000 
Events in all, one can place the cost of the RXD Events for these 20 
systems at approximately $600 million out of the estimated total of 
S10 billion invested by the DoD In research between 19^3 and 1963- The 
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il t In- i v'-oiu u-.i 1 Incut ii>n pioCi-ilurv viKjijcsUciin t lit- d i biuii i on 
finding h. •>'. IWtM tt to Tic devvTiipbd mid implemented, sublt.nrg ina I 
r^xMi'Cii task*, could be identified i:i a scimewhot less subjut t' ve fashion. 

**• i» ♦>.*. lit Ih c ha I loupe : The support of scientific research 
in the universities, by tile DoJ) anti at current 
funding levels, 6iynif icarit ly affects the aval labi I i ty 
ol the best faculty talent to leach students. 

Obviously, any activity undertaken by a professor other than 
teaching or counseling the student body could detract from his primary 
work simply by reducing the lime available for it. But it is generally 
agreed that the professor must coht i nue to do—or to direct —research in 
his chosen-area or risk having his scibntific expertise rapidly diminish.. 
Thus the real concern {and this may be inferred from the challenge) is 
whether or not DoO-supporled research activities at a university have, 
in the balance, a deleterious effect on the students. 

The investigations under Project HINDSIGHT do not provide a direct 
and unequivocal answer to this challenge. But many of the findings, 
reinforced by conclusions of other relevant studies, 7 offer useful 
insight. Findings of this Project that bear on this matter (developed 
more fully in section 5.3) are summarized here: 

Most important, the HINDSIGHT data show that the universities re¬ 
ceiving the greatest amount of DoD funds for research graduate a dispro- 
portlonatly high percentage of the people who later produce the science 
and technology used by the Departmentof Defense. Specifically, the 23 
universities responsible for doing most of the research that the DoD 
supports in academic Institutions award only 25 percent of the doctorates 
earned in the United States, but that group includes 50 percent of the 
Ph.D.'s who have been identified as important contributors to RXD Events. 
Similarly, the 23 universities most heavily supported in research by the 
DoD award about 11 percent of the Master's degrees in science and the 
arts in the nation* but kb percent of the identified contributors re¬ 
ceived their degrees at these schools. 

The findings of Marquis, Allen and de Solla Price, 8 based on their 
studies of the postgraduate education of the country's engineers, are 

• ’l . G Marquis and T. J. Allen, American Psychologist, 21_, 1052, 

]Sb ( Derr4 J. de Solla Price, "Is Technology Historicaily Independent 
o- science.’ ^ Study In Statistical Historiography," Technology caul 

Cidti,-..-., K ; k. Fail!365, pp. 553-5&8. 
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thoroughly consistent with the foregoing observations, and clearly sug¬ 
gest that the engineer continues through life armed primarily with the 
science he learned as an undergraduate student. The greater his profes¬ 
sors' knowledge of the stale of the art, the more advanced was his 
scientific education. So it is not surprising to find a possitive cor¬ 
relation between the level of the DoD's support of a university's re¬ 
search and the subsequent useful productivity of Its graduates. 

The time elapsing between an engineers' graduation and the peak of 
his productive work—on the average, about 10 to 15 years—seems to be 
independent of his scholastic experience. All the patterns revealed in 
this study suggest that it is a function of the rate of the individual's 
contact with actual working problems. At this distance from his last 
significant exposure to science, the engineer has learned enough about 
typical problems and their technical solution that he can solve a new 
technical problem on the basis of that experience and his knowledge of 
science. 

In brief; All observable quantitative measures deny that there is 
any great substance to the challenge that Dob-supported research in 
universities has a generally harmful effect on the students at those 
institutions. 
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ADimiONAI IlNDlNiiS 


Iho primary data hasi* of Project HINDS Kill I consistv of 710• ili icn.-te 
tvonL .descr ipt ions: in tin- presi.fibitd formal (sw Appendix C) .and 511 de- 
u,ilod biographical sketches ot' the performers involved. Of the Event 
ilfscri pt ions , 68<t ore complete in oil essential details; Z6 are adequate 
to support only o portion of the analyses. The findings presented in 
■ection U are those considered most relevant to the questions outlined in 
sections I and 2 of this report, hut the analyses on which they were 
based did not exhaust the potentials of the accumulated data. 

In this section and the next two, this information is considered 

further. First, the data are displayed, and where possible correlated 

with the findings of other reported researches, and some inferences are 
drawn. Sections 6 and 7 contain additional inferences regarding the 
nature of a high-payoff research envi ronntent and future Defense require¬ 
ments for research funds. 

5.1 Quality of the Data' 

5.1.1 Uniform!ty : Despite efforts to maintain uniformity in the 
data base, there is a considerable amount of unevenness in the more sub¬ 
jective areas. Problems arose, for example, in separating the reaily 
inventive activities that advanced science and technology from more 
routine engineering work barely within the state of the art. Consensus 
of the study teams was the primary criterion for screening the activities 
in this respect. A review by the Project Director followed, resulting 
in the rejection of 2 to 3 percent of the Events surviving the first 
scrutiny. Undoubtedly, another independent review would have somewhat 
different results. 

Also contributing to the data's lack Of uniformity was the diffi¬ 
culty met in ascertaining the precise terminal point of an EVerit. By 
definition, an Event terminated at the instant feasibility was first 
demonstrated or validity proved. In practice. Judgments about what con¬ 
stituted proof of validity differed widely. Because this problem was 
never satisfactorily resolved, the distributions of Event duration and 
cost were viewed in the data analysis as only general % indicative of 
the situation, 

5.1.2 Nature of the Events : Although each Event was considered 
unique, a preliminary analysis suggested that it would be possible to 
class'fy most of the Events by type with a relatively limited set of 
descr ptors. To this end, 15 descriptors were selected; and for each 
Event it was stated, "This Event advanced the state of the art by the 
application of ■ to _for _employing the three ap¬ 

propriate descriptors from the following list. 
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DESCRIPTORS FOR Cl.ASSUYINT, IV1NIS 


Mathematics 
Njtur.ll phenomena 
Speci f ic fund ion 
New technique 
"’’Established lechniqut 
New nkiteri.il 
Established material 

The consequent distributions were analyzed, with the following 
indications: 

5.1,-2.1 Scientific Events : Al<ouL9 povctit of ike Evi.uls 
involved diaecvcrica o i* advances arising from oeieitlifie invasiitjnliohr. 

It should be noted here that a very rigorous definition of "science" 
is used in this report (see Tabie II). For example, it is not synonymous 
with the DoD budget category "research," although there is a useful 
degree of similarity. In interpreting the significance of the 9-percent 
figure, however, it is more important to know that, even though the 
Event occurred in a university and the performers might normally be 
called scientists, if the nature of the work tended more toward technol¬ 
ogy than science the Event was categorized as technological. This par¬ 
ticular finding, therefore, says nothing about the relative value of 
scientists vs. engineers or of an organization's science and eng* Wiring 
departments. 

Recently the Department of Defense budget for research has been 
roughly one-third the size of the one for exploratory development. If 
there is any relationship between a program's size and the number of 
utilized results, the 9- to 91-percent ratio of scientific to technolog¬ 
ical Events—rather than the logical 1:3 ratio—suggests that, in prac¬ 
tice, a considerable portion of the work funded by the DoD as research 
is in fact technology, not science. 

5.1.2.2 Materials : The development or application of new 
materials was the subject of slightly over 30 percent of the Events. Of 
those, about 3 percent actually resulted in the creation of a new mate¬ 
rial. The remaining 97 percent dealt with the exploitation of a new. 
material's characteristics (a) to permit the use of a new manufacturing 
process (13 percent), (b) to enable the development of a new device 
(16 percent), or (a) to advantageously replace an older material for 
reasons other than manufacturing economy (68 percent). 

For example, the last category might Include the replacement of 
germanium by silicon in solid-state devices, or the use of aluminum in¬ 
stead of steel in the carriage of a howitzer. 

in general, this finding clearly demonstrates the importance of 
materials research in the advancing of technological capabilit/. The 
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l st uhl isii»*d Inn (.lion 

Manufacturing (piucessj 

Equipment 

Analysis 

Design specification 
Theoretical validation 








distributions within this 30 percent of tvents, however, suggest tiut 
efforts devoted to yui niiKj j complete understanding of all character¬ 
istics of a new material and to ensuring that this knowledge was widely 
distributed throughout the engineering comniun i ty wou I d be more useful 
than attempts merely to seek another, somehow improved material. Ob¬ 
viously, a commensurate recomnendution vould be slated in terms of 
relative emphasis rather than a choice ot alternatives. 

5- 1.2.3 . Functions: In determining whether the consequence 
of an Event was the ability to accomplish a new function, as opposed to 
improved ways of performing an established function, it was necessary 
to use definitional criteria. 

In general, if an older device or technique could have been used 
to achieve the operational characteristics set by the engineei—-even at 
a higher cost or with slightly less reliability—it was held that the 
Event merely offered better ways of executing an established function. 
Converselv, if the Event resulted in a higher level of capability than 
existed before (e.g., greater power output by a radar transmitting tube, 
higher specific impulse of a new propellant), the result was considered 
to be a new capability. 

Within these broad criteria, the invention, of devices or tech¬ 
niques, other than through the exploitation of a new material, accounted 
for 33 percent of the Events. About 75 percent of these made possible a 
net# function or offered a new capability; 25 percent offered improved 
ways of accomplishing an established function. These figures suggest 
that, early In the engineering development of a system, about three times 
as much attention Is paid to meeting performance specifications as is 
given to lowering cost or increasing the system's rellabiIIty. The data 
would therefore support the hypothesis that, at the time of engineering 
development, most advanced weapon systems are at or near the technologi¬ 
cal state of the art. 

5.1.2.4 Design : Inventions, or concepts, involving ap¬ 
proaches to system or subsystem design were the bases for a little more 
than 4 percent of the Events, or an average of about 1.5 Events per 
system studied. 

In the opinion of the study teams, this suggests that the funda¬ 
mental concepts underlying these systems and major subsystems did not 
differ greatly from those on which other existing military equipments 
of lower performance were based. The main conclusion is that markedly 
advanced new weapon systems emerge as a consequence of the skillful 
selection and integration of many innovations from diverse technologies, 
which combine to produce the performance demanded. )t is uniikely that 
such weapons would come into being as the result of the mythical "great 
new idea." ... 








5'. 1.2.5 H r ub Ifn i Analy sis: Almost I h percent of the lvi.nl*. 
evidence a different But not twcess.iri ly unexpected characteristic. 

They appear to consist t>f analyzing a problem in detail and coupling the 
results with an almost morphological survey of available technologic-*, in 
order ie firid a useful so lull on. None of these Events tun be described 
as »• period of treat i vity to! lowed by the lest of an idea that came inio 
bemgdut-iny that period. Thd ingenuity observed in this class of 
Events is revealed more particularly in the framing and analysis of the 
problem than in the'eventual solution. 

Philosophically; the activity described would seem to '’1 low the 
common concept of engineering more closely than the finding 5.1.2.3) 
that some 33 percent were inspirational inventions. If the data had 
been structured somewhat differently in this portion of the report, many 
Events included in the discussions of scientific research (5,1.2.I) and 
materials (5.1.2,2) would also have consisted of analysis followed by 
solution. In fact, that may be a more typical description of an Event 
than the one chosen for the HINDSIGHT study (see Appendix B). U cer¬ 
tainly is easier to understand the high cost of scientific and technical 
research when one appreciates the tremendous amount of analysis and 
search involved. 

5.1.2.6 Other Events : Finally, 11 percent of the Events 
lack arty obviously common characteristic, except that each involves 
some amount of creativity or ingenuity. 

5-1.3 Content of the Events : The Events can also be usefully cate¬ 
gorized in terms of the primary scientific or technical area involved. 
Since the weapon systems and equipments selected for this study are gen¬ 
erally typical of those that are important to the DoD, it may be conjec¬ 
tured that a ranking of the sciences and technologies, in terms of the 
frequency with which Events occurred in each, would give a measure of 
their relative importance in, at least, the immediate past. The Field 
and Group Structure^classlfication code and descriptors of the Comm!ttee 
on Scientific and Technical Information (COSATl) were used, with the 
resultant distribution shown in Table VIII. 

It cannot be concluded from these data that electronics Is more 
important to a missile system than, for example, propulsion, navigation 
or communications. In the absence of any one of them, the final system 
would very likely be inadequate. Because each Event involved skilled 
people, however, the distribution In Table VIII suggests the relative 
number of scientists and technologists that would be required in each of 
the areas listed to maintain a balanced base of professionals. 


^COSATl Subject ‘Category List (DoD-Extended) (Washington, D.C.; 
Defense Documentation Center, Defense Supply Agency, AD-624 000, Decem¬ 
ber 1965). [COSATl—Cornrnlttee on Scientific and Technical Information, 
Federal Council for Science and Technology.] 
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Table VIII. SCIENTIFIC AND TECHNICAL AREAS OF EVENTS: 

FREQUENCY OF OCCURRENCE 


Area ______ : - l 


Electronics------- 25.2 

Ordnance--——---■*—--—-12.3 

Missile technology-—-——-—— 10.5 

Propulsion and fuels----- 9.9 

Aeronautical science—----——■—.— 9.9 

Materials science---—-7.7 

Navigation and communications-—-—------ 6.4 

Physi cs—.——-.—r-r———r- 5.3 

Mechanical and Civil engineering---— 3.2 

Methods and equipment—-2.1 

Behavioral science-————-———-.- 1.9 

Chemical technology- 1.7 

Mathematics----—- —1.5 

Nuclear science---—-- : -- t— 0.6 

Biological science--- 0.6 

Atmospheric science-'-------—— - 0.4 

Military science-*-—— -- 0.4 

Energy conversion----—- 0.4 


5.2 Motivation for the Events 

In this study, motivation is defined in a very narrow sense. The 
objective here was to ascertain what recognizable influence, if any, led 
directly to the creative act : Identified as the start of an Event. Ex¬ 
cluded were such matters as the reason the performer was in, a position 
to do the relevant work, whether the effort was sought of his own voli¬ 
tion, what personal drives may have contributed to his motivation, and 
the like. In this way, the task was considerably simplified. 

5.2.1 Kinds of Motivation ; The "permitted 11 categories of motiva¬ 
tion were those shown in Table IX. Definitions of directed and undi¬ 
rected research are given in Tables III and IV. Alternatively, these 
categories might be more adequately described as phenomena-oriented and 
applications-oriented research—but only if it is clearly understood 
that neither orientation Would exclude Investigations of a basic nature. 
Within these definitions, the eight very important Events In the history 
of the transistor are classified as directed research because they all 
occurred at the Bell Telephone Laboratories, which Is obviously appli- 
cations oriented. 
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Table'IX. U1STR1UUH0N OF MUI1VAIKJNAL LATLGORIL.S 



Ca tegory of motivation 


Science: 

"’ Directed research (DoD) 7.0 

Directed research (non-DoD) 2.0 

Undirected research (0.2) 

Technology : - 

Generic (DoD-oriented) 27.0+2 

Advanced development or system concept 41.0 +2 
System In engineering development 20.0 

Not DoD-oriented 3.0 


In generic technology, the attention of the performer is directed 
to a broad spectrum of functionally similar, general-purpose technologi¬ 
cal building blocks. Examples of this class are general-purpose transis¬ 
tors, ferrous and sprfie nonferrous structural materials, liquid and solid 
rocket propellants,explosives, and printed-circuit boards. As the 
focus of the performer's attention is sharpened by the consideration of 
possible specific applications suggested by a particular system concept 
or by a system actually in preprototype development, the motivation for 
his efforts falls into a new category—advanced development or system 
concept. 

There is an overlapping of generic and system-concept technology (n 
many aspects, especially when the same people are responsible for both 
system design and the sponsoring of growth In the relevant technologies. 
For example, there are regions of technological overlap in missile guid¬ 
ance and radar in which it is difficult to assign an effort to either 
category with any degree of certainty. Further, the performer often 
finds it hard to unequivoeably trace his motivation. Thus, from 2 to j 
percent of the Events shown as generic and system-concept technology 
might be shifted. 

5.2,2 Other Motivational Links : In addition to determining the 
performer's motivation, information was sought regarding other, non- 
psychologlcal factors that might have directed his attention toward the 
activity that culminated iri an Event. In a very crude sense, the moti¬ 
vation was the objective that guided the performer, whereas the motiva¬ 
tional link is the reason he was so guided. 

Table X presents the distribution of Events among the eight most 
obvious links. The three percentage columns show the sequential partici¬ 
pation of each link in an Event Involving additional acts of creativity. 
Of the several categories, contractual requirement, routine area assign¬ 
ment, and spontaneous internal conception are self-explanatory. In the 
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olliorv, the portiiriwr* wei'f informed of the existence pi <i need, or <J 
possible solution for on already identified problem, by way of the in¬ 
dicated transfer link. 





Table X. MOTIVATIONAL LINKS 


Category 

Primary (X) 

Secondary {%) 

Tertiary (X) 

Contractual requirement- 

— — 11.1 

30.5 

38.1 

Routine area assignment- 

.47.8 

42.7 

33.3 

Technical report—— 

—— 14.8 

18.1 

16.6 

Professional meeting— 
Extraorganizational 

. 1.5 

2.2 

4.8 

person-to-person - 

Spontaneous internal 

-•—- 8.0 

5.1 

• 2.4 

conception-———-- 
Analysis of foreign 

_-— 9.5 

0 

0 

product——- 

- 0.5 

0 

2.4 

Newly hired personnel-— 

. 1.6 

1.4 

2.4 

No link apparent----- 

.—- 5.2 

0 

0 


The dominance of the routine area assignment among these categories 
should have been anticipated in the light of other findings of this 
study. As noted in connection with finding 4.3.7, In 85 percent of the 
Events the creative activity was in response to a problem brought from 
outside the performing group. Where more logically should a problem be 
taken than to a group pf professionals who are known to be regularly 
working in a technical area in which a solution is likely to be found? 
And what most probably would be the nature of a solution offered by a 
group that is active in certain technological areas? 

In describing the production rate of RXD Events, Table VII (page 
48) demonstrates that a mission-oriented establishment (the In-house 
laboratory), if at all involved in an Event, tends to he deeply Involved. 
Apparently, having developed expertise in areas pertinent to its mission, 
the laboratory Is brought relevant problems by outside organizations 
that recognize this expertise. 

These findings form a consistent pattern and consequently offer 
some guidance to management. They suggest that usable ideas are more 
likely to be produced if an organization deliberately establishes a 
reputation for skill in a limited number of problem-associated technol¬ 
ogies, instead of diversifying its talents over a wide range of techni¬ 
cal fields. 


> ,* 
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Int.tmuU ion was gathered wi th regard to (wo aspect*, of Lvent I •Hid¬ 
ing: (I) Who furnished the money? (2) Approximately liw much money was 

involved? An Event was restricted by definit ion to the “ini Iial demon¬ 
stration of validity, or. Feusi.bi lily* 1 in Hit* hope oT keep inn tiie number 
of funding sources to a manageable minimum, but even so multiple funding 
was found to be a common occurrence. In fact, 20 percent of the Events 
had at least two simultaneous or consecutive sponsors, and 6 percent had 
at least three. Dual funding by consecutive sources appears to have 
resulted from one or more of several situations: 

(1) The idea occurs in an organisation that is unwilling to 
fund more than the most superficial test; 

(2) The idea occurs in an organization that lacks the techni¬ 
cal ability to accomplish the requisite tests; or 

(3) The idea occurs in, and is tested by, one organization, 
but a second organization which is unwilling to accept those test 
results funds a more detailed project. 

The simultaneous funding by multiple sources invariably happened 
when two or more organizations were interested in pursuing an idea and 
agreed to share expenses or talent, or both. 

Table XI shows the frequency with which the several identified 
funding sources appeared. 


Table XI. FUNDING DISTRIBUTION FREQUENCY 



Department of Defense--- 574 131 37 

Defense-oriented industry: 

Specified industrial R&D- 18 1 0 

Specified profits from 

otherDoD contract-—- 3 0 0 

Unspecified- 51 2 0 

Non-defense industry-- 35 4 2 

Non-DoD Federal-———-- 8 0 0 

Foreign and miscellaneous— — 9 0 0 


Table XII reduces these data to participation percentages on the 
basis of number of Events rather than funding level. 
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l)i'pu» linunl of Ucfi'iivf ii4.fi 

Defensu-orientiui industry J3.6 

Other industry 4.b 

Other Federal 1.0 

foreign and miscellaneous 1.0 


Each of the 28 Events in which there was simultaneous multiple 
funding involved the DoD os one contributor and defense-oriented industry 
as the other. Distribution of consecutive funding participation by 
sponsor may be inferred from Table XI. Where the initial support came 
from eitiier the DoD or defense-oriented industry, the follow-up support 
was provided by the DoD. Where non defense 1 industry furnished the 
Initial support. It tended also to give the follow-up support. 

The actual dollar level at which a given Event was supported varied 
from none (other than the performer's sajary for a few days up to a 
week) tOv figures well in excess of a million dollars. The information 
was provided by the Event performers, who generally attempted to esti¬ 
mate, in terms of men, materials and overhead, a dollar equivalent that 
would be an approximate measure of the Event's cost. These data are 
considered roughly indicative of the cost of advances in science and 
technology. 

8ecause these estimates concerned the approximate cost of Incidents 
that had occurred as much as 20 years before, and because there was 
little uniformity in the way the many study participants applied the 
definition of an Event, an average Event cost is not a particularly 
meaningful figure. Instead, the median cost of an Event is offered as 
being more descriptive of the situation. Table XIII gives median cost 
figures for the dominant Event categories, and Table XIV displays Event 
cost distribution, regardless of source or other factors. 


Table XIII. MEDIAN COST OF EVENTS 


Category 

Median cost 

Science 

$60,000 

Technology (DoD-funded Event) 

45,000 

Technology (industry-funded Event) 

33,000 
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Table XIV. DISTRIBUTION OF LVf.NT COST 


Cost range 

_ % _ 

Under $10,000 

17.7 

$10,000 - $50,000 

32.6 

$50,000 - $100,000 

19.0 

$100,000 - $250,000 

17.0 

$250,000 - $500,000 

6.3 

$500,000 - $1,000,000 

3.5 

Over $1,000,000 

3.9 


5.4 Idea Protection 

The flow of ideas, as well as their application, may be restrained 
by controlling the information in three ways: Assigning it a Defense 
security classification, labeling it proprietary, usually to industry, 
or subjecting It to the patent process. The incidence of these re¬ 
straints among the 710 Events is shown in Table XV. Since it is possible 
for an idea to be patented and at the same time classified as Defense 
security information, the percentile figures are not additive. Nor is 
"Special Handling" additive, for it is a subclass of both "Secret" and 
"Confidential." The number of Events that are (or were) considered to 
be proprietary information by the performing organizations Is not known. 


Table XV. IDEA PROTECTION 


Restraint 

% 

Defense security classification: 

Special Handling 

2.5 

Secret 

4.6 

Confidential 

12.2 

Patented 

18.0 


Recognizing that this study has identified most of the important 
scientific and technical advances In weaponry and other military equip¬ 
ments over the past two decades, and in viewof the current European 
concern over the so-called technology gap, 10 these data are particular¬ 
ly enlightening. To the extent that such a gap exists, Federal security 


10 H.R, Lieberman, "Technology Gap Upsets Europe," New York Timex, 
12 March 1967- 




control over the flow of informalion is obviously noL a significant con¬ 
tributor. In 8j percent of the tabes there. Wdi no legal constraint on 
open publication of the information. . 

The data, of course, do not measure the effect on information flow 
of constraints imposed by Defense contractors, either by discouraging 
their people who might desire to publish or placing deliberate restric¬ 
tions on proprietary information, 

5.5 P articipating Organizations 

In the same way that an attempt was made to curtai l fundi rig sources 
the definition of an Event was deliberately framed to minimize the pos¬ 
sibility that a number of organizations would be found to have partici¬ 
pated in any one Event. Again, success was not complete. Only in 78 
percent of the Events was all the technical work done within a single 
organization. In 17 percent of the cases, two organizations were iden¬ 
tified, and in S percent there were three. Where multiple performing 
organizations were identified, the combinations included the following: 

Government laboratory /Government laboratory 
Government laboratory / university 
Government laboratory / industry 
industry / university 
industry / industry 

Thus it is not highly illuminating to discuss the distribution of per¬ 
forming organizations in terms of percent of Events by organizational 
class. Instead, Table XVI presents the incidence of participation in 
Events as a function of organization ciass. 


Table XVI. INCIDENCE OF TECHNICAL PARTICIPATION 
. BY CLASS OF PERFORMING ORGANIZATION 

' 1 Incidence 

Organization class _ (%) 


Government laboratory---—-- 

DoD-.——-^- 

,non-DoD————.—-.- 

i ndustry-roperated-—— 

- 43.6 

- (42.3) 

- (0.9) 

- ( 0.4) 

__ 44 ? 

profi t-—-—- 

not-for-profit—---—.. 

University_■- — _ t__ - _ 

- (42.3) 

- ( 1-9) 
_10.6 

academic institution-—- 

r0se3rch center - - - 

~ (5.4) 

( 5.2) 

Foreign laboratory (all classes)- 

— r.e 
100.0 
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Sine* Idbi.t* XVI covert. I Ik- elllin; pi*nud I urn- Iy45 lb I'Jbi, it iv - 
not a measure of the cut rent tolai iv»* 'i input titt'icf *»l .tlifsi- oig.iiii/af inuol 
classes, Ihe trend in rot alive iinpoMuhci* of- ttir Cove rumen I lahoiui at >• 
ami itufuslry, the two primary contributors over the whole t i nit; I ram.-, i •, 
illustrated in figure 12 (page 38). 

Section 4,3.1 noted that about 75 percent of the uni versity- 
credited RXl' tvents came from associated science and technology cenleis 
or arose out of recognizably mission-oriented programs (e.g., the inves¬ 
tigations in.missile base drag charade-istics. Event No. 0060, under 
the direction of Professor Korsl, University of Illinois). About ha 1f 
of the RXD Events that took place In academic institutions proper fell 
into the category of those that were recognizably mission oriented. 

Thus, the referenced paragraph and Table XVI are consistent. 

5,6 Contributing Scientific and Technical Personnel 

In tracing the histories of the utilized new science and technology, 
1,295 people were Identified as having made significant contributions to 
RXD Events. Detailed personnel rdsumds were obtained from 514, almost 
kO percent of them. Analysis of those rSsumds provides the distributions 
pre: nted In subsequent paragraphs. 

Two relatively simple tests were applied to the sample as a check 
on its validity. In the first test, the distribution of rfisumfis, in 
terms of category of employing organization, was compared with the dis¬ 
tribution of Events that occurred within that organizational class. The 
results of this test are shown In Table XVII. 

Table XVII, DISTRIBUTION OF R&UM£s AND EVENTS BY ORGANIZATION CLASS 


Organization class 

Events (X) 

Resumes (X) 

In-house laboratories 

43.2 

35 

Industry 

43.6 

53 

Universities 

10.6 

12 

Other 

1.6 

0 


The second test, involving a time distribution study, was to com¬ 
pare the percentage of the total number of Events that occurred in a 
'given year with the percentage of the rdsumfis that applied to individuals 
who had made their contributions in that year. The findings demons tret• 
a positive correlation at the 0.93 level. 11 The rdsumds seem to be a 
usefully valid sample. The slight bias In favor of Industrial per¬ 
formers will be considered later. 


^Spearman's coefficient of rank correlation: 
,^ 2 . r where: d 


difference in ranks, 
number of items ranked. 
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•\ usi-ful and uni(.|iii‘ uh.ir.ii ler ist it, ul I In' pci simile1 dul.i till; is 
th.ll .‘very iii.it pi the individuals wliosi* ditsti ipt ions inukt: up the* 1i Il¬ 
ls known io h.m> nkido n utilize I coin r Unit inn to Defense scienu- nr 
technology. this factor permits useful comp.i i i suns between ilu: HINDS K.lll 
contributors and the general scientific and teclmicul cuiinnuiii t ies ul i lu¬ 
nation. The unii|ue aspect of the fi le is that iit of fees, an opportunity 
to lest a number of hypotheses regard my productivity and the conse¬ 
quences of mattaijerial policy actions. Such comparisons am) analyses are 
presented in sect ions 5.7 through 5.11. 

5.7 education 

Taolu XVIII shows the. distribution of academic degree levels ainong 
the identified contributors anti comparable data for the entire national 
scientific arid engineering community.... 


Table XVIII. EDUCATIONAL LEVEL OF IDENTIFIED CONTRIBUTORS 


Source of Data* 


-Degree 

HINDSIGHT 

NORC 

SRI 

NSF 

EJC 

Ph.D. 

10.5% 

3.1% 

i*2% 

3.8% 

r 

M.S. 

22.5% 

8 .6% 

7.2% 


1 63% 

B.S. 

57.0% 

34.6% 

47.0% 



Some college 

6 .8%. 

39.5% . 

{44.6% 


{37% 

No college 

3.2% 

14.2% 



Note : ^Sources of data are as follows: 

NORC: S. Warkov and J. Harsh, The Education and Training of 
America's Scientists and Engineers: 1962 (Chicago: 
National Opinion Research Center, University of Chicago, 
October 1965), p. 17. 

SRI : . A; ;| :Shapero, R.P, Howell and J.R. Tombaugh, An Exploratory 
j Stft$y of the Structure and Dynamics of the E&D Industry 
• (MdnNd PdrK, California: Stanford Research Institute, 

• Junfe 196b), p. 31. . • 

NSF: Profiles of Manpower in Science and Technology (Washington, 

D.C.: National Science Foundation, NSF 63-23, 1903), 
p. \jff, . 

EJC: "How Many Engineers?" Engineering Manpower Bulletin, No. 5, 

Engineers’ Joint Council, New York, July 1966. 
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At the Ph.D. level, data from the Stanford Research Institute (SRI) 
are probably the most useful for comparison purposes; th.it is, for Ph.D,, 
the 10,5 percent identified through Project HINDSIGHT should be compared 
with the I;2 percent in the SRI column. The pharmaceutical, petrochemi¬ 
cal, biological, anthropological and sociological iields, with their 
relatively heavy concentration of Ph.D.'s, markedly Influence the data 
of the National Opinion Research Center (NORC) and the National Science 
Foundation (NSF); this condition Is not significant in the SRI data be¬ 
cause that related primarily to the defense aerospace community. The 
equipments chosen for the HINDSIGHT study mitigated against any strong 
contribution from these Ph.D.-heavy fields, so it is reasonable to 
exclude them entirely from this particular analysis. 

At the M.S. level, the difference between the SRI ^nd NORC data is 
probably not statistically significant. 

5.7.1 Hypotheses : A comparison of the educational-level distribu¬ 
tions with those of any other source clearly suggests that the Identified 
contributors do not constitute a random sample of the general scientific 
and engineering community. Prevalence of the Ph.D. degree Is more than 
eight times greater than would be expected; the M.S. degree, over three 
times greater. This observation might be explained, wholly or impart, 
by one or more of several hypotheses. Perhaps— 

(1) "there Is a positive correlation between the technical 
nature and the amount of formal education to which an individual is ex¬ 
posed and his propensity for producing knowledge that is useful In 
defense weaponry; 

(2) the personal qualities that drive an individual to seek 
progressively higher academic degrees are quite similar to those requi¬ 
site to successful performance as a contributor of science and technol- 

V» ogy useful to Defense; or 

(3) the prestige of the higher educational level places the 
Individual in a position affording greater opportunity to perform. 

The principal findings of Project HINDSIGHT (as presented In section 
A) develop a strong case for the DoD's support of directed research in 
science and technology. They do not—-perhaps because of the more tenuous 
information flow and communication path between the universities and 
Defense engineering—-make as strong an argument for continued DoD support 
of the less well-directed scientific Investigations In the academic en¬ 
vironment.- There are good reasons for the DoD's support of university 
research, however, and a quantitative demonstration of their validity is 
possible. 

An important part of the argument resides in the demonstration that 
the first of the foregoing three hypotheses is clearly valid and better 
explains the correlation between degree level and productivity. The 
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consequence*, of DoD influence on the choice of scientific area of concern 
trot ion in the supported universities is maiii fested by the relatively 
greater portion of those institutions' graduates who eventually make 
militarily significant contributions to science and technology. 

5.7.- Sources of Education : Among the identified performers, 98 
percent of the degrees were awarded by colleges or universlties In the 
Uni ted States. The remaining 2 percent, awarded by foreign Institutions, 
were almost exclusively Bachelor's degrees, B.S. or B.A. In 1959, ap¬ 
proximately the year of the median Event considered in Project HINDSIGHT, 
the university-trained scientific and engineering manpower of the United 
States was slightly in excess of 1.09 million people. 1? Of these, about 
20,000 were immigrants who had received their education abroad. 13 Thus, 
on the assumption that there Vs no correlation between source of the 
degree and propensity for productivity In defense-oriented science and 
technology, it would be expected that about 2 percent of the identified 
performers would have received their degrees at foreign universities— 
precisely the finding of this study insofar as the B.S./B.A. level is 
concerned. 

The B.S. degrees awarded in the United States came from more than 
70 colleges and universities. The distribution among these many insti¬ 
tutions appears to correlate solely—and then, very crudely—with the 
size of the university and its proximity to the Industrial organizations 
and Government laboratories that contributed large numbers of Events. 

Both observations tend to support the hypothesis that prestige, or some 
unidentifled personal characteristics, account for the disproportionately 
high percentage of degreed individuals among the Event performers—at 
least, at the B.S./B.A. level. 

Table XIX lists fields of technical activity 14 represented by the 
identified VXD Events and shows the relative distribution of B.S./B.A. 
fields among the performers in each technical area. The data in this 
table clearly demonstrate a very marked correlation between the specific 
area in which the person was educated and the one In which he usefully 
performs. Even though degree holders in technical areas other than those 
closely associated with a given Event had essentially the same total 
exposure to formal education—and presumably the same amount of degree- 
conveyed prestige—as Individuals whose education was within the closely 
associated degree area, relatively few "cross-field" accomplishments are 
seen. This observation is offered in partial support of the first 


12 "Resources of Scientific and Technical Personnel In the OECD Area, 
1963," Manpower Statistics, 1954-1964 (Paris: Organization for Economic 
Cooperation and Development, 1965). 

l ^Soientifio Manpower from Abroad (Washington, D.C.: National Science 
Foundation, NSF 62-24, 1962), 

COS ATI Subject Category List (DoD-Extended ), op.cit . 



73 




































































































-V 

*J$j. 


>' 

$ 



hypothesis stated above—that there is a positive correlation between the 
technical''nature, and amount of formal -education'.to-which an individual is 
exposed and his propensity for’producing useful knowledge. 

Additional support for this hypothesis is obtained by considering 
the sources of the M.S. and Ph.D. degrees held by the Identified per¬ 
formers. Although the Department of Defense has supported research In 
about 200 col leges and universities throughout the United 5tales, the 
larger share cf this support has; gone to a relatively smal I group of them. 
If the research efforts Supported by the DoD were closely related to the 
technical areas of defense weaponry, and if there is a correlation be¬ 
tween nature. and amount of formal education and propensity for producing 
useful knowledge, there should be a correlation between the amount of 
DoD funding Support received and the number of>identified performers 
graduated. That is, the universities heavily involved in defense- 
oriented research should be producing a relatively greater number of 
scientists and engineers with a defense-technology orientation than those 
concentrating their research activities more heavily elsewhere. 

Considering first the Identified performers who have been awarded a 
Ph.D.: The top 23 universities. In terms of Support received from the 
DoD for research, awarded approximately-25 percent 16 of the Ph.D. 's in 
the physical sciences and engineering during the period of primary in¬ 
terest to the HINDSIGHT study. Slightly In excess of 50 percent of the 
identified performers, or a factor of more than 2:1 over random expec¬ 
tation, received their highest level degrees from those universities. 

At the M.S. level, a similar situation exists; In this, case, the 
same universities awarded about 51 percent 16 of the degrees In the United 
States, but 46 percent of the Identified performers received their de¬ 
grees from them. 


u 
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As these are the larger and generally the better known of the 
American universities, they undoubtedly have a strong appeal for the 
better students, It Is quite likely, therefore, that the findings just 
described are influenced by factors other than simply the relative 
amount of research supported by the DoD. In particular, the phenomenon, 
"quality seeks quality," can be suspected of affecting the entering stu¬ 
dent. Nevertheless, there is such a marked correlation between the level 
of DoD-supported research and the relative production of scientists and 
engineers useful to the DoD that the hypothesis of interest certainly 
appears to be supported; clearly, the nature of formal education is 
important. 


I . :• 

I 


15 Privately requested data from the National Science Foundation. 

1 ^Ibid. 
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5./, 3 Consequences of POD Support of University Research ; At This 
point in the consideration of the three hypotheses stated in section 
5.7.1, another matter of interest should be noted. The introduction of 
this report (section 1} offered a hypothesis based on comments by critics 
of certain DoD policies; 

The support of scientific research In the universities, by the 
Department of Defense and at current funding levels, signifi¬ 
cantly affects the aval lab)11ly of the best faculty talent to 
teach students. 

If this hypothesis were substantially true, It would be expected that 
graduates of the less heavily supported universities would benefit—that, 
because the university devoted its better faculty to teaching them, the 
graduates should have acquired a better education and, everything else 
being equal, should show up more frequently in studies such as this. 
Clearly, such was not the case during the time frame in whtch the iden¬ 
tified performers received their formal education. The universities 
that were most heavily engaged In DoD-supported research also produced 
a disproportionately high share of the scientists and engineers who were 
important to the DoD. 

Further, inasmuch as the level of DoD funding in support of uni¬ 
versity research has not grown during the past few years as rapidly as 
either (1) total Federal' support of research in the universities or 
(2) graduate education In the United States, It is most doubtful that 
the hypothesis would be any more valid today. 

5.8 Military Service 

In section 4, the argument was developed that the recognition of a 
need is an important precursor to the production of utilized scientific 
or technical Information. It Is reasonable, then, to suspect that ex¬ 
posure to the mi 11tary envlronment might serve to Introduce an Individual 
to the needs of the services and place htm in a favored position to make 
a contribution. If true,'this proposition could become of considerable 
value by providing an additional selection criterion for employment in 
the defense research and development community. 

in the sample of Identified performers, the roughly even division 
of those who had mi 1itary experience and those who had none suggests 
that, at least to a first-order approximation, exposure to the military 
environment may not be a significant factor. But the prospects of this 
proposition are so appealing that a more detailed examination of the 
available data Is warranted (section 5.8.1); moreover, the proposition 
sheds Further light on the hypotheses of section 5*7*1. 

In addition, two possible tests for other differences between the 
military veteran and nonveteran populations involve relative educational 
and age levels at the time of contribution (sections 5.8.2 and 5.8.3). 
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5.8.1 Nature and Length of Service : If a correlation ex' 
tween mi l i tary service and the probabi1 i ty that the person lnv< 
produce militarily useful technology, it Is obvious that the pi 
nature of the military role he played would be significant. Ii 
vein, 51 percent of those reporting previous military service < 
that the nature of their assignments was such as to contribute 



future occupation. These qeneral statements are substantiated by the 
high percentage of military Job titles such as "radio and radar mainte¬ 


nance," "electronics technician," "ordnance technician," "aircraft - ,main¬ 


tenance," and the like among those who reported in; that detail. 


Other aspects of the veteran performers' association with the mili¬ 
tary services lend further support to the argument that they are not a 
normal, or random, segment of the population. Based on population dis¬ 
tributions, approximately 10 to 12 percent could have been expected to 
be commissioned off leers; in fact, 40 percent were commissioned prior to 
separation from service. Of that group, 53 percent served during World 
War I I, and 47 percent, between 1947 and 1963- Similarly, of those who 
served as enlisted men, 56 percent were in the armed forces during World 
War II, and-44 percent served during the period 1947-1963. 


With the exception of a few people who apparently were called into 
military service quite early In World War II and served until the end of 
hostilities, the Identified performers tended to have 2 or 3 years of 
service. Approximately 51 percent of those with military experience re¬ 
ported 2 years or less; 86 percent reported 3 years or less. 


Thus, a "typical" veteran performer might be described as a young 
enlisted technician or a technical officer. He had bench-level experi¬ 
ence with military equipment and a real opportunity to become Tamiliar 
with special design or other requirements imposed on equipment by the 
nfilltary environment. This suggests that these veterans may we 11 have 
gained a favored position, which constitutes an obvious advantage. 


5.8.2 Educational Level—“Veteran vs. Nonveteran : There are inters 
esting differences in the distributions of graduate degrees held by 
rionveterans and veterans, the latter subdivided into two groups—com¬ 
missioned officers and enlisted men. These distributions, shown In 
Table XX, suggest that the commissioned veteran was more apt to haVe a 
higher degree than either the nonveteran or the enlisted veteran, In 
that order. This ordering, although not denying that military service 
had put the Individual In a favored position to perform usefully,tends 
to support the second hypothesis of section 5.7.1, In fact, it appears 
that the hypothesis can be extended as follows: The personal qualities 
that drive an individual to seek successively higher academic degrees 
and military rank are quite similar to those requisite to successful 
performance as a contributor of science or technology useful to defense. 


During the information-collecting phase of Project HINDSIGHT, no 
attempt was made to ascertain the reasons for the differences between 
the enlisted veterans or all veterans and the nonveterans. However, a 
plausible explanation can be conjectured. First, it Is quite likely 
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Figure 15. AGE OF PERFORMER AT TIME OF CONTRIBUTION 






lluil. in «i number i»l Lhcs, c,iuso andv( feet can be inlen. hanged; that 
i . il ma> b<* ^uspecU’d th.it at least some ol those.who earned graduate 
degree*, weie, as students, held by their Selective Service Boards in a 
defer rail status until after graduation. By then, many efleetively 
avoided mi 1itary service because of marital status, relatively advanced 
age or special employment. Second, many of the performers who had their 
advanced degrees before World War 11 were draft deferred because of im¬ 
portant scientific and technical assignments vital to the national war 
effort. 

Table XX. DEGREE DISTRIBUTIONS: VETERANS AND NONVETERANS 




Veterans 



Postdoctoral 

1.4% 

1.0X 

1.2* 

0.42 

Ph.D. 

11.1 

5.5 

8.1 

10.9 

M.S./M.A. 

25.0 

19.6 

21.5, 

22.9 

B.S./B.A. 

55.5 

59.4 

57.3 

56.7 

Some college 

5.6 

10.3 

8.6 

5.7 

Technical school 

0 

1.4 

1.0 

1.7 

High school only 

1.4 

2.8 

2.3 

1.7 


It was noted in section 5.7 that there is a correlation between 
level of academic education and propensity for advancing the state of . 
the art of mi 1itary science and technology In a useful manner. The 
arguments presented In the foregoing several paragraphs suggest that 
practical experience with military equipments, or perhaps attendance at 
one of the mil 1tary services' schools in preparation for such an assign¬ 
ment, 17 tends to give a measure of equalization. This explanation would 
rationalize the generally lower educational level of the enlisted vet¬ 
eran, who is the one most likely to have taken a course at a highly 
specialIzed technical service school. Further, It supports the hypothe¬ 
sis that a correlation in fact exists between nature as well as level of 
education and tendency to pe*rform usefully in Defense RED. 

5•8.3 Age at Time of Contribution—Veteran vs. Nonveteran : An 
examination of relative age distributions, veterans vs. nonveterans, at 
the time a contribution was made produces Inconclusive results. Some 
veterans completed all or part of their education before entering the 
military service. Others started undergraduate or graduate work after 
leaving the service. Among all performers, as shown in Figure 15, there 
was considerable spread in age at the time of contribution. The Inter- 
quai.lie range of what approaches a Poisson distribution is (-)3 and 


17 This information was not solicited; because of the known tendency 
of the services to give special schooling to technicians, however, the 
possible impact of this factor cannot be ignored. 
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raobi I i ly.«% .i person changes the n.ilun* ol' his wui h .within <i single 
ory.ini/.il ion, i .e. , change*; ulliei lli.ni those- involving scientific or 
Unlinu-.il .ire.is o.l inti*It".I (section 5.9.3). 

Of these thiee forms of mobility, only inlc-roryani/ationol moveinent 
is known to h.ive been situlied to any great depth. Shnpero and others 
investigated the movements of several thousand scientists antl enqiue< i s, 
primarily of the aerospace research and development commoni ty. 1 * To a 
I iniited extent, the characteristics of the individuals (dentilfed 
throuqli Project HINDSIGHT can be compared with the SRI findings. 

In the following sections (5.9.1 through 5.9. , *)» HINDSIGHT data are 
further analyzed lo continue testing the hypotheses presented earlier 
and lo provide a base line for future studies of the behavior patterns 
of scientists and engineers. 

5.9.1 ProfessIona1 Mob111ty : This kind of mobility was defined 
in the foregoing paragraphs as the propensity of an individual for 
crossing the ioosely recognized boundaries of scientific disciplines or 
areas of technology- A measure of the professional mobility of the 
identified performers is obtained through analysis of the matrix in 
Table XIX, a comparison of the fields of technical activity represented 
by the RXD Events with the relative distributions of degree fields at 
the B.S./fi.A. level among the performers associated with each technical 
activity. 

For purposes of analysis, professional mobility Is further defined 
as encompassing the expectation, that a given individual will make a 
significant scientific or technical contribution in a field other than 
that for which he was prepared by formal education. That expectation, 
then, is measured simply as the ratio between (a) the number of individ¬ 
uals who, because of degree field, might normally be expected to make no 
contribution in a specific area and (b) the total number of individuals 
making contributions in that area. 
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f mm the same raw data lh.il provided Table XIX, a pi of ebb ional - 
mobility index for performers wi.lh BiS. or B.-A. deg i ties is calculated to 
be 0.1/. S i m i I ,u i ,i I culm ions for peri o rule is v/hose lii'jlies t degree is 
M.S. .a- M.A. result in a inoli i lily index ot 0.13'- For the Pli.D. level, 
an iiHlex.nl, O.OA is. found. Thus, expected inolii I ily at the M.S./M.A. 
level is more than three times"greater than it is at the Ph.D. level; 
and about lour times (jrealel at the B.S./H.A. level. 

The rank ordering of this finding is not at all surprising. The 
realization that the data suggest that only some A percent of the Ph.D.'s 
can be expected to make contributions outside their originally chosen 
fields, however, suggests that Ph.D. training within 0.S universities 
is quite narrow. 

In part, perhaps, this finding—the lack of professional mobility 
on the part of Ph.D.'s—explains the earlier finding of a correlation 
between DoD-supported research in universities and the defense orienta¬ 
tion of those universities' graduates. The degree fields shown as the 
abscissa of Table XIX are obviously quite broad. Vithin these fields, 
each Ph.D. candidate selects some subfield for specialization. If he is 
influenced in this choice by a faculty adviser engaged in DoD-sponscred 
research, if his research is oriented to military uses, and if his 
mobility (i.e., movement) from the subfield is little greater than it is 
from the general field, it is not surprising that he is found later to 
be making a useful contribution to science or technology significant to 
the DoD. 

These arguments further support the first hypothesis of section 
5.7.1 that there is a positive correlation between the technical nature 
and the amount of formal education to which an individual is exposed and 
his propensity for producing knowledge that is useful In defense weaponry 

Realizing that the faculty for an M.S. degree candidate is, to a 
considerable extent, made up of the Ph.D. candidates just mentioned and 
their faculty advisers, It Is almost to be expected that the M.S. candi¬ 
date would become "defense oriented." 

Why the M.S. degree from a university where the DoD supports re¬ 
search is relatively so much more prevalent among the identified per¬ 
formers than the Ph.D. degree Is not readily apparent. One possibility 
that cannot be discounted is that exposure to a defense-oriented faculty 
has caused a greater than average percentage of graduates from these 
universities to seek employment in the defense industries. This matter 
is researchable; such a project may already have been undertaken, but, 
if so, the findings have not been widely circulated. 

Another but more subjective measure of the lack of professional 
mobility among the identified performers may be seen by comparing Table 
VIII (a list of the scientific and technical areas involved in RXD 
Events), in terms of frequency of occurrence, with Table XXI, which 
shows the distribution of degree fields by educational level. In 
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addition. Table XXI gives the current distribution ol the defense RtO 
work force in the Los Angeles area as determined by the Stanford Research 
Institute, 1 ' 1 

Table XXI. DISTRIBUTION OF DEGREE FIELDS BY EDUCATIONAL ILVLL 


HINDSICHT sample Los Angeles area 

Field ___ B.S. M.S. Ph.D. __ (all degrees ) _ 


Electrical engineering 30% 

Mechanical engineering 26 

Physics 15 

Chemical engineering 7 

Chemistry 7 

Aeronautical engineering 6 

Mathematics 3 

Metallurgical engineering 1 

Civil engineering 1 

Industrial engineering 1 

Physical chemistry 0.5 

Nuclear engineering 0.5 

Nuclear physics 0.5 

Education 0.5 

Biology 0.5 

Organic chemistry" 0.5 


33% 

19% 

23.4% 

16 

7 

18.7 

21 

18 

7.1 

5 

7 

( 5.4 ) 

3 

0 

‘ ( ] 

5 

5 

12.4 

12 

14 

1 7.5 

2 

0 

0.9 

1 

0 

2.0 

1 

0 

1.1 

1 

7 

NSi 

0 

0 

NS 

T 

0 

NS 

1 

0 

NS 

0 

14 

0.5 

1 

2 

• ( ) 


Notes: Columns do not add to 100 percent because of round tug. 
*( ) ,-r- Included within chemistry. 

§NS — Not shown separately. 


With the primary exception of the aeronautical engineers, the dis¬ 
tribution in the Los Angeles R6D complex is seen to correlate reasonably 
with that of the HINDSIGHT performers. The exception undoubtedly is 
occasioned by the prevalence of the aerospace Industry in that area. 
Again, as in Table VIII, Table XXI offers some guidance on the relative 
numbers of scientists and engineers (by discipline) that will be required 
In the near future, assuming no major change In the nature of the equip¬ 
ments to be developed for the military services. 

5.9.2 Interorganizational Mobility : It was noted previously that 
the biographical sketches of the contributors Identified through Project 
HINDSIGHT were collected during 1966 and were current as of that date. 
Thus,it Is possible to examine the interorganizational mobility of 


19 A. Shapero, R.P. Howell and J.R. Tombaugh, The Structureand 
Dynamics of the Defense R&D Industry: The Los Angeles and Boston 
Complexes (Menlo Park, California: Stanford Research I nstitute^ November 
1965), P. 2k. 
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those people over o long period of time—in some cases, as much as 40 
years. In Figure 16, the sample of performers is examined with respect 
to total years of piofessional civilian experience vs. frequency of 
occurrence. Half of the sample had between 13 and 24 years of experi¬ 
ence. The median length of employment was shown to be in excess of 16 
years. 

Shapero and others studied the engineer/scientist work force of the 
defense RED industry in the Los Angeles and Boston areas.Based on 
the age distribution they reported for the work force, the median length 
of employment for their sample appeared to be between 8 and 9 years, or 
about half that found for HINDSIGHT RED people. The distribution about 
the median for the R&D population in the Los Angeles and Boston com¬ 
plexes forms a pattern very similar to that shown in Figure 16, except, 
of course, that it is markedly displaced toward the origin. Despite the 
obvious considerable difference in average total length of professional 
employment, the HINDSIGHT performers appear to have made fewfer total 
moves. Comparative data are shown In Table XXII. 


Table XXII. INTERORGANIZATIONAL MOBILITY 


NO. Of 

Previous 

SRI 

HINDSIGHT 

0 

24.7% 

29.2% 

I 

21.2 

26.5 

2 

17.2 

14.7 

3 

13.3 

19.3 

4 

9.1 

6.4 

5 

6.4 

3.8 

6 

4.0 

0 

7 

2.8 

0.1 

8 

0.8 

0 

9 

0.2 

0 

10 or more 

0.3 

0 


Undoubtedly the value of many Individuals identified through the 
HINDSIGHT studies had long been recognized by their •;respective employers, 
it certainly can be expected that whatever appreciation these employers 
expressed, plus whatever satisfaction the individuals.derived from 
knowing that their work was being used, contributed to the relative 
stability of their employment. Nevertheless, it is interesting that the 
successful performer is not as prone to change jobs as his average pro¬ 
fessional associate. 



'°Ibid. , pp. 22 and 23, 
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A somewhat different cause-and'-ef feet relationship may be inferred 
from Hits apparently low mobility, along wllh.l.i data on age at the 
time of contribution (see Figure 15). Together, they suggest that the 
person had been with his employer for some time before making the noted 
contribution. This could mean that, because of his long service with 
the organization, he was in a favorable position to have his ideas 
recognized and exploited. The inference would be entirely consistent 
with the finding (section '4.3.7) that: A high combined inventiveness, 
or ingenuity, and'uti 1 izatlon rate are dependent upon the time and space 
coexistence of four primary factors—the recognition of need, a source 
of idea's in the form of an educated talent pool, capital resources and 
an adequate communication path to potential users. 

The general educational level of the contributor already has been 
established. Add to this the fact that, through long years of associa¬ 
tion with his company, he had acquired specialized experience in its 
technical affairs and had developed the ability to interpret Its needs 
and problems. Then, only the resources that one Could expect would be 
made available to a trusted employee are necessary to complete the four 
factors named in the finding. 

On balance, it appears logical to conclude that It is the Indi¬ 
vidual's low Interorganizational mobility that leads to successful 
performance rather than his performance that leads to job stabi1ity. 

5.5.3 Intraorganlzational Mobility : The HINDSIGHT contributors 
show as little propensity for moving within a company as they do for 
moving between organizations. The Information they submitted suggests ~ 
that, on the average, each person had held two different positions 
within his organization. In most cases, he changed from a Job calling 
primarily for activity in a given scientific or technical field to an 
assignment chiefly involving management responsibility in the same tech¬ 
nical area or one of somewhat larger scope. 

This finding appears to be entirely consistent with—and possibly 
helps to explain—the previously mentioned finding that there Is a very 
high degree of professional stabi1ity among the identified contributors 
(see section 5.9.1). To some extent, this stability may be encouraged 
by the fact that senior management may be reluctant to make assignment 
changes that would force the employee into "professional mobility," i.e., 
into another scientific or’technical field. Of course, it may be that 
management merely accedes to the employee's Insistence that he be al¬ 
lowed to remain within his chosen technical area of work. 

This is a researchable question, but it was not addressed in the 
HINDSIGHT Task I study. A more thorough understanding of the matter 
would be useful, because it may be that management has Inadvertently 
adopted a policy that mitigates against the fullest exploitation of its 
most creative employees. 
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5,9.k Education and Respo nsibility : The third hypothesis, in sec¬ 
tion 5.7.1 suggested that the correlation between level of education and 
propensity for making utiIized toutributions might merely be based on 
the fact that the prestige associated with the higher academic, degree 
held by the individual placed him in a favored position to perform suc¬ 
cessful ly. • 

A partial test of the hypothesis can be made by comparing educa¬ 
tional achievement with other measures of success within the profession¬ 
al society. Specifically, degree level can be compared I wlththe Indi¬ 
vidual's hierarchical rank within the organization. To facilitate this 
test, six categories, or "responsibllity/authority levels," were estab¬ 
lished, as shown in Table XXIII, and the sample of identified contribu¬ 
tors was separated, by degree level, into those classifications with 
the results given In Table XXIV. 


. Table XXIII,. 

RESPONSIBILITY/AUTHORITY LEVELS 

Level 

Assignment 

Division director 

Supervision of several branches related by 
business or object interests. 

Branch director 

Supervision of several groups related by 
discipline. 

Project manager 

Supervision or coordination of two or more 
groups related by project. 

Group manager 

Supervision of one or more working-level 
people.' 

Professional 

Degreed scientist or engineer at work level. 

Semi professional 

Technician. 


It is obvious that, in absolute numbers, the top four responsiblli- 
ty/authority levels are dominated by people whose highest degree was at 
the B.S./B.A. level. This finding is partially a consequence of the 
fact that the largest percentage of the identified contributors is In 
the Bachelor's degree group. The distributions of the managerial segment 
of Table XXIV can be adjusted to compensate for unequal degree-level 
distributions among all performers (Table XVIII), with the results 
shown in Table XXV. 



Libit! XXIV. UfMlGilT 

ED DISTRIBUTION: 

lit OKI 1 VS. RI SI'ONSIBIL 

ITY LEVEL 




1 ducation 

Some 

High 

Responsibi1ity Level 

Ph.L). 

M.S. 

U.S./B.A. 

college 

school 

Division director 

26% 

20 *. 

51% 

3% 

. ' 

Branch director 

13 

22 

52 

- 3 


Project manager ; 

6 

25 

61 

6 

21 

Group manager 

7 

29 

58 

4 

2 

Professional 

IT 

20 

61 

6 

2 

Semiprofessional 


* 

10 

45 

45 

Note: Horizontal rows 

add to 

TOO percent. 



Table XXV. WEIGHTED DISTRIBUTION: DEGREE VS. RESPONSIBILITY LEVEL 




Education 







Some 

High 

Responsibility level 

Ph.D. 

M.S. 

B.S./B;A. 

colleqe 

school 

Division director 

43% 

33% 

16% 

8 % 

_ 

Branch director 

34 

28 

26 

12 

- 

Project manager 

13 

26 

25 

21 

15% 

Group manager 

. 15 

32 

24 

14 

15 ■ = 


At the two highest levels of authority, degree level and responsi¬ 
bility are seen to be positively correlated and monotonically decreasing. 
Recognizing that the degree fields of these individuals were science and 
engineering rather than management, this finding does suggest that the 
prestige conferred by the higher degree has an influence in achieving 
promotion. Or, as in the case of people with military experience, it 
may be that whatever personal characteristics drive one to seek higher 
degrees have much in common with those that impel one to seek positions 
of responsibility. 

The distributions at the levels of project and group managers are 
not at all inconsistent with either or both interpretations. The data 
on responsibility/authority levels relate to the contributors 1 current 
positions, nbt their positions at the time of the RXD Event involved, 
further, the length of time that most of those individuals had been 
employed suggests that, in the preponderance of cases, they were at or 
near the highest positions of authority to be expected. Thus, Table XXV 
demonstrates that there is a weeding-out process and that the person 
holt ng Lhe higher degrees can.expect commensurate rewards. 

It is clear, however, that this analysis—intended to test the 
correlation between degree-conferred prestige and propensity for making 
militarily useful contributions to science and technology—resul ts in 
equivocal findings. Prestige may be a factor, but it does not appear to 









Further analysis of the biographical sketches suggests that inier- 
orgoninational stability also correlates positively with responsibility/ 
authority level—,it least, among Uu* identified successful performers. 
Table XXVI displays the relationship between number of previous employers 
and hierarchical level of responsibility achieved by 1966. Only manage¬ 
ment levels are considered. 


Table XXVI. RESPONSIBILITY/AUTHORITY LEVEL VS. 

NUMBER OF PREVIOUS EMPLOYERS 


Responsibility/ 
Authority Level 


No. 

of Previous 

: Employers 

. ~ ' 

0 

1 

2 

3 

4 

5 or 
more 

Division director 

28% 

.19% 

28% 

18% 

4% 

3% 

Branch director 

32 

21 

22 

6 

10 

9 

Project manager 

33 

26 

17 

10 

. 9 

3 

Group manager 

34 

33 

11 

14 

5 

3 


Note: Percentile by row. 


Comparison of the information in Tables XXV and XXVI suggests that, 
at the division-director level, some tradeoff is accepted between the 
Ph.D. degree and number of previous employers. That is, at this highest 
level the Ph.D degree is somewhat more important than interorganlnation¬ 
al stability as a criterion for promotion. This is additional evidence 
that prestige associated with degree level correlates with the attainment 
of positions of higher responsibility and authority. It is noted, how¬ 
ever, that this particular finding is not necessarily relevant to the 
hypothesis concerning nature and level of education and propensity for 
useful contribution. 

5.10 Marital Status 

For the current engineering and scientific work forces of the Boston 
and Los Angeles R£D complexes, Shapero and others reported that 70.9 per¬ 
cent of the males were married, 27.3 percent were single, and 1.8 percent 
were divorced or separated at the time they were hired. 2 * The somewhat 
higher average age of the HINDSIGHT contributors at the time their bio¬ 
graphical sketches were collected (A3 vs. 36 years) precludes a usuful 
comparison. Nevertheless, the differences are great enough to warrant 
reporting. The distribution among the HINDSIGHT contributors was found 
to be: 

Married--r——94.0% Widowed.0.4% 

Single-——-— 4.9% Ever divorced—4.0% 

Divorced or separated-- 0.7% 


7 'Xbid., p. 26. 
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11 is prinuri ly the difference; ini lie r> di voiced dr separated" 
figures, despite tlie relatively small percentage in either case., that 
maybe must interesting. The,repeatedly noted tendency toward stability 
—in terms of areas ofprofessional interest, in terms of employers, in 
terms of posilions within an organization—is further evidenced by the 
apparently greater marital stability qf the successful contributor. 

ji ■ I I Continued Postgraduate Educatio n 

In addition to formal education leading to the award of a degree, 
many of the contributors reported attending one Or more postgraduate 
courses. Well over f>0 percent of the individuals participated in short 
courses or lectures series sponsored by their employers. The available 
information on these courses, which varied in length between a few 
hours and a few weeks, is inadequate as a basis for analysis of the 
quality or significance of the instruction. A somewhat smaller group 
reported that they had taken formal courses offered'by recognized uni¬ 
versities either on or off campus. Table XXVII presents a distribution 
of the latter information in terms of the highest degree held by the 
reporting person and by the general nature of the course. 

Table XXVII. POSTGRADUATE EDUCATION 


Type of Course 

Ph.D. 

M.S. 

B.S. 

Technical 

. 6% 

m 

10% 

Administrative 

0 

4 % 

1% 


In some cases, the individual had delayed taking a formal course 
for as much as 20 years after receiving his last degree. The average 
delay appears to be about 7 years, and the median, about 5 years. 

No comprehensive information concerning the practices of the 
defense-oriented RsD community is known to be available. There are 
some data on individual organizations and on the entire national scien¬ 
tific and engineering community, however, that offer a limited basis 
for comparison. 


The National Science Foundation 22 estimates that about 5 percent of 
the country's scientists and engineers are currently taking part-time 
university work. From the NSF data, it Is not possible to determine the 
« total percentage that continue with postgraduate education at one time 

* or another over the years. 


?z Zola Bronson, National Science Foundation, private correspondence, 
August 1967. 
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At the individual prqani/ntMmal level, I. M. Rub in'* 1 report-, that 
by I 967 mo it- than 90 percent, of the professionals at the Langley Research 
Center, National Aeronaut les and Space Adminis trot Ion, had taken at least 
one formal university course under the auspices of NASA's continuing edu¬ 
cation program, with approximately one-third of the staff participating 
in any recent year. At the Army's Harry Diamond Laboratories, tih percent 
of the professional staff completed courses of aL least one semester's 
duration during the period 1 96 ^ 4 -1967. 

By any of these measures, the identified contributors to RXD Events 
are markedly in the minority. 

One can speculate, of course, that the contributors are leaders in 
their fields, and therefore are more likely to develop information to be 
taught their peers than to learn it in a classroom. Or it could be that 
the contributors tended to travel so much in the course of their work 
that taking even part-time classes was impracticable. Whatever the 
reason, it is apparent that these valuable, creative people were not 
given to exploiting the opportunities for continued postgraduate educa¬ 
tion that are offered by most of the larger universities. 

5-12 Summary and Discussion 

These additional findings combine to present extraordinarily con¬ 
sistent patterns. Host of the scientific and technical ingenuity and 
innovation leading to modern weapon systems is found in a very conser¬ 
vative, almost routine environment. For example, nearly half of the 
advances came about as a consequence of what the performers considered 
to be routine assignments (Table X). The persons credited with the 
advances give evidence of extreme conservatism. In comparison with 
others In their professional society, they tend more to remain in the 
scientific or technical areas in which they were educated, to stay on 
the same job with the same employer, and to be satisfied with the level 
of education attained before they first sought professional employment; 
they even tend to have more stable family lives. The chief possible 
departure from this otherwiseconsistent pattern is their apparent will¬ 
ingness to move from their chosen technical fields into management 
positions when they were- relatively young. 

To a considerable degree, this may explain why comparatively few of 
the technological Events were found to be based on the results of recent 
scientific advances. For Is It likely that individuals with such stable 
and conservative traits would delve Into what Is, to them, the unknown 
For the solution to a problem? Certainly not, if such a digression 


23 l.M. Rubin and H.G. Morgan, A Projective Study Towards Continuing 
Education (Boston: Sloan School of Management, Massachusetts Institute of 
of Technology, 1967). 

24 Maurice Apstein, Harry Diamond Laboratories, private correspon¬ 
dence, August 1967. 



,voided. If the characteristics, oi people mkhhj ‘>'9"" ^ 
ical contributions in areas other than weaponry are equally 
ive, there is little wonder that new scientific findings mo 
into everyday engineering.' ’ 



Jacob S chmook 1 e r. Invention and Economic. Growth (Cambridge: 





Preceding Page Blank 


6. RESEARCH ENVIRONMENT FOR HIGH PAYOFF 
6•I RDTsE Environments 

Management has tended to create different environments for funding 
control and the decision process in the several phases of the RDTcE 
cycle. In addition, it is alleged that significant Intellectual and 
sociological differences may be found between the classic organizational 
structures identified as "Government in-house," "university-associated" 
and "industrial" laboratories. Presumably some one combination of the 
factors making up the various environments should be more effective than 
others for fostering creativity and the utilization of its products. 


One of the primary stated purposes of Project HINDSIGHT was to 
Identify management factors that constructively affect the productivity 
of a scientific or technical research program. It is emphasized that 
the factors sought were those associated with the combination of creativ¬ 
ity and use of results. Quite possibly, the optimum environment repre¬ 
sents a compromise; it may not be the best situation for scientific 
creativity alone, or the best for innovation. 

An immediate observation based on one of the HINDSIGHT findings 
(see section 4.3.1) is that the broad categorical differences between 
Government, university and Industrial laboratories do not markedly in¬ 
fluence productivity In terms of the emphasized combination-creativity 
and result usage. Similarly, the study shows that productivity is not 
restricted to the environments associated with the ReD categories of 
either research or exploratory development. 

Based on the 686 RXD Events on which pertinent data are available, 
the percentage distributions among the Defense Rfift categories were found 
to be: 


Research— -—-9% 

Exploratory development—28? 

Advanced development- -k0% 

Engineering development—22? 

Management and support—->1? 

A considerable number of Events occurred before 7 June 1962, the 
date on which these categories were formally established. Those Events 
were categorized, insofar as possible, through analysis of the circum¬ 
stances in which they came about. When there was significant doubt, 
the Event was ignored in calculating percentage distributions. Thus, 
the distribution is only roughly descriptive of the situation and is of 
interest primarily because the peaking occurs in the advanced develop¬ 
ment category. Obviously, creativity and the Imaginative application 
of scientific principles can be found in work relating to every phase of 
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ilu' it.OTfct iyile. IN oilucl i vi ly is signi I u jnl ly . 11 i yt. t vd r i I Ih- i |»y I «t. 
tors common lo each ul the i>ry.»ni/.il ionul and builyc l i rig t.nt i cjorics. 
considered here or by ili f It-rent sets of fai l or*. that apply within o.ich 
category. 

This—study was not deep enough to sense different sets of factors 
— if, in fact, they do exist. Subsequent paragraphs consider the find 
fogs with regard to apparently significant environmental factors. The 
several classes of research, from undirected scientific research through 
research, in technology, are treated in turn, and the findings are dis¬ 
cussed in relation to pertIncut management factors that seem to be 
controllable by policy. 

Based on the methodology employed in Project HINDSIGHT, only 
successes were studied. It cannot bo concluded, therefore, that this 
"most effective" environment wiII ensure success; failures have happened 
and probably will continue to occur.'- Because other patterns of manage¬ 
menthave Tailed to exhibit as high a utilization rate, however, it must 
be assumed that thpir efficacy was lower and their failure rate ( at least 
slightly higher. 

To this point, payoff has been considered only as the recognized 
use of results proceeding, from the research effort on a military system. 
Other forms.of payoff were observed in the course of Project HINDSIGHT, 
but the establishment of their relative value to a mission-oriented 
agency such as the DoD is beyond the scope of this study. It Is clear, 
however, that they do exist and, by and large, tend to be associated 
with generally undirected research in science. (See section 2 on HIND¬ 
SIGHT objectives, strategy and methodology.) 

6.2 Research in Science 

6.2.1 Undirected Basic Research : There is very IIttle evidence 
that ideas spawned during recent basic research, particularly in the so- 
called undirected basic research In science, as opposed to directed 
research (Tables III and IV), manifest themselves in Improved weapon 
systems. In the fields of statistical analysis, other aspects of infor¬ 
mation theory, nuclear physics and polymer chemistry, a very few exam¬ 
ples have been found in fohidh payoff was identified in a system. 

Nevertheless, it has been seen that, wherever there was a payoff of 
basic scientific research in terms of use in systems, its value was 
comparatively great. Examples are found in ail 1 Sol id-state electronic 
systems, nuclear weapons and power supplles, Information processing in 
computers and radars, and the application of statistical sampling in 
quality-control techniques. 

The greater payoff of undirected basic research in science identi¬ 
fied in HINDSIGHT studies has been observed in forms other than direct 
weapon-system application. In terms of numbers, the gain has been in 
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the training of scientists and engineers who performed the directed re¬ 
search in basic science or In technology that led to the new weapon 
systems. The technique of investigation, the so-called scientific ap¬ 
proach, that has been developed and propagated by the universities has 
had a tremendous observable impact. 

section 5.7 demonstrated how valuable university-trained scientists 
have been to the Department of Defense—in particular, those trained In 
- universities that had defense-oriented research programs. When the DoD's 
recognized dependence on schooled scientists and engineers is considered, 
along with the fact that In a typical year (FY 1965, for example) approx¬ 
imately *6 percent 2 * 1 of the nation's scientific and engineering talent is 
engaged work that is directly or indirectly Defense supported, the 
magnitude of the payoff may be appreciated. 

The second very useful product of undirected basic research is the 
Instrumentation developed by the scientists In their quest for knowledge. 
If there is a characteristic difference between undirected and directed 
research In science, It Is probably that the former examines ail possible 
aspects of a phenomenon in detail, while the latter tends to be more 
restricted in scope, focusing on the apparently most pertinent aspects. 

In their desire to observe in totality, the performers of undirected 
basic research have developed instrumentation that is exotic and precise. 
The resulting devices were identified through Project HINDSIGHT as they 
became the tools of the applied scientist and the engineer. 

The nature of a third payoff of undirected research is suspected 
but has not yet b>en well established. Often the candidate for a 
Master's degree In science or for a Ph.D. bases his thests or disserta¬ 
tion on research Into a particular characteristic of a device or mate¬ 
rial. If the results of this research in any significant amount are 
collated by the publishers of the commonly used engineering handbooks, 
this third form of payoff is established. This matter is being investi¬ 
gated as part of Project HINDSIGHT'S more detailed studies of management 
factors. 2 ' 

6.2.2 Directed Basic Research : No sharp lin^. of demarcation is 
found between theoretical, undirected research in science and Its di¬ 
rected counterpart. . Instead there is an almost continuous spectrum, 
from the case In which the scientist undertakes a particular line of 
investigation "because it looked interesting" to a ventuie that is 
totally, responsive to the request of an outsider. 


26 Estimated from the ratio of Defense spending to total national 
expenditures for RSD. Reviem of Data on Science Resources (Washington, 
D.C.: Narlon?l Science Foundation, NSF 65-11, May 1965), J_, M. 

27 Robert C. Mills, Liaison Activities at RAD Interfaces—A Model ; 
Some Empirical Results and Design Considerations for Further Study 
(Evanston, Illinois; Northwestern University, June 19&7). 
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typically referred to ; 


systems took the form of a "mop-up" effort. Engineers were employing'a 
technology with some degree of success but didn't understand in detail 

how.orwhy. t workdd. Scientific analysis led to a better unierst^nding 
and eventual ly to greater exploitation of the technology. 9 

were found''n f ^ relUm 0n inVeStment *•" scientific mop-up research 
TJfllTt? • 3 Y WeaP °" SySteffl Studied * ^oblems of extracting 

information from contemporary radars led to filter-theory research 

u:?;J n r tUrn ^. ,ed , t0 far ,nore capable radars. Propeller-noise prob- 
nJeded f to cavrtation-theory studies that generated th.e knowledge 
needed for designing less noisy propellers for torpedoes. Problems of 
S r« , " U ‘ !“’ h reCt “ t “ rt ' l ~ «*»» .furn.steThe 

rationale for pertinent scientific research. 

Relevant research probably results in a high payoff in utilization 
for two interrelated reasons: (l) the scientific research was known to 
and /?? * S ! fU i area , su 9|ested by a problem in the associated technology: 

exist 2 for Tn d L mar M t - f ° r c ny new know,ed 9 e generated was known to 
ex st, for in-advertising their problem the engineers identified them- 
selves as potential users, Profitable directed research* as described 
tLJ h L^ eCe !H 9 exa TP ,es * quires a fairly direct line of communica¬ 
tion between the engineer and the scientist. J 

. Msearch in Materials: Another class of research in science 

observed in the Project HfNOSIGHT studies has had an equal or greater 

payoff. Wei rover half the identi fied technological advances clearly 

denend e d th * abse ? ce of ne * scientific ideas. Almost ell.however, 

depended upon the existence of new information on characteristics of 
materials or the operation of devices such as the transistor. - The class 
of research that leads to new materials, to measurements of those mate- 
rials^ characteristic?., and eventually to the publication of pertinent 
data has been of primary value. 

From the pragmatic view of a mission-oriented agency, fairly 
S ^'" 9e ^ criteria for the class of research leading to reference texts 
and handbooks can be established. The producers of the documented in¬ 
formation or their managers, must remain aware of the technical prob- 
lems of the engineering community. Further, deliberate attempts must be 
ma-e to anticipate Information needs, particularly as the engineer begins 
to push the state of an art to its limit. 9 

Section 5.1.2.2 discussed the Importance of identifying, publishing 
and disseminating information regarding the characteristics of new 





rtidlerials. in this part icu.VaV example, the* infonn.it ion is amenable to 
presentation in a handbook. But tilt* concept involved—t ha t of deliber¬ 
ately investigating natural phenomena and reporting the results in what¬ 
ever form is required for maximum utility to the engineer—can be applied 
with equal validity in any scientific discipline. 

6.2.4 Genera] Observations : It must be remembered that all identi¬ 
fied RXD Events have two common characteristics: First, 1 as a consequence 
of research in science or in technology, some new knowledge was made 
available. Second, this new knowledge was employed by an applications 
engineer in the design or development of a weapon system or piece of 
military equipment. 

None of the findings or observations presented in this report 
should be interpreted as claiming that undirected research in science 
during the past 20 years has not produced a great deal of useful infor¬ 
mation. Rather, the findings suggest that the transfer of undirected 
basic research to technology for weapon-system development can require 
20 years or more. This transfer of the scientifIc base may be Influenced 
by early recognition of a need or technological opportunity, by effective 
coupling between the scientific and technical communlties, and other 
variables that require further definition and analysis. ‘ 

The data from this study indicate, however, that there does exist a 
shorter time span between scientific discovery In directed basic research 
and Its practical 'Utilization than between undirected basic research and 
Its practical utilization; this should be expected. The median time be¬ 
tween the occurrence of scientific events identified in the directed 
basic research category and the Incorporation of the resulting new knowl¬ 
edge Into the design of a weapon system was nine years. Thus, it Is 
evident that a motivation toward system application influences the time 
for transfer of basic research events into system development. This 
observation in no way derogates the continuing requirement for expanding 
the frontier in the scientific disciplines. 

It is clear that, on a time scale of 50 years or more, undirected 
scientific research has been of immense value. Without basic physical 
science, we could scarcely have developed the modern technologies of 
nuclear energy or communications or the current electrical and chemical 
Industries, None of the Identified scientific Events would have been 
possible without the use of one or more of the great systematic theories 
—classical mechanics, thermodynamics, electricity and magnetism, rela¬ 
tivity and quantum mechanics. These theories also played an important 
role in many of the technological Events. For example, if one were to 
count how many times Newton's laws, Maxwell's equations or Ohm^s law 
were used in the systems studied, the total would far outnumber the 
recent RXD Events identified. 

In less than 5 percent of all Identified RXD Events, scientists or 
engineers were called In to "make someone else's solution work." In 
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85 percent of the cases, a fundamental problem was presented to the 
creative individual or group and a new and successful solution was con¬ 
ceived, The evidence is so overwhelming that no question should remain 
regarding the role of the scientist or research engineer vis-S-vis the 
applfcations engineer; neither can be subservient to, or unaware of, the 
other. Each performs best when free to cope with the fundamental prob¬ 
lem, Any environment that enhances coordination would encourage the 
higher payoff of research. These general observations, by suggesting 
specific fruitful activities, implicitly recognize this fact. 

6.3 Research in Technology 

6.3*1 Subclasses: General and Restricted: Of the identified RXD 
Events, 91 percent are reasonably classified as research In technology. 

The characteristic that distinguishes that kind of effort from the equals, 
ly Important but somewhat more pedestrian work of applications engineer¬ 
ing Is the relative amount of technological risk involved. Before an 
RXD Event could be so classified under. Project HINDSIGHT, there had to 
be evidence that the performers, though confident in their prospects, 
realized that success was not a reasonable certainty. More specifically, 
experiments to establish feasibility must have been designed and actually 
performed. 

Again, as in the case of directed scientific research, two signif¬ 
icant subclasses of highly productive Utilized research in technology 
were observed, both Involving before-the-fact recognition of a techno¬ 
logical problem. They differ* primarily in the manner in which the 
problem area is identified. For purposes of classification, they are 
described in this discussion as "general" and "restricted" technological 
research. 

General technological research: In the first subclass, the 
performer's attention was focused on a broad spectrum of functionally 
similar general-purpose technological building blocks. Outstanding 
examples included work supported by the DoD laboratories that led to a 
multiplicity of transistors with selective, highly predictable charac¬ 
teristics and economical techniques for their manufacture and production; 
small compatible passive electronic devices; ferrous and nonferrous 
structural materials and fabrication techniques; liquid and solid rocket 
propellants; and explosives. 

Restricted technological research: The second subclass 
covered the development of devices or techniques with fairly restricted 
applications. It included such items as the investigation of missile- 
launcher design, the development of engine and missile-motor components, 
and specif 1c missi1 e-guidance components of inertial quality. 

In terms simply of the number of RXD Events identified in each sub¬ 
class, 30 percent of al1 the technological-research Events studied were 
general, and 70 percent were restricted. (The matter of the subclasses 1 
relative value is discussed in section 6.3.4.) 
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6, j,2 Management Aspects : Differentiating between the subclasses 
from a management viewpoint, we find in the "general" subclass a low 
risk that research results will not be used as long as the product in 
anyway represents an advance in technology. But, without very close 
coordination or centralized management, there Is a high risk of duplica¬ 
tive research efforts. In the "restricted" subclass, on the other hand, 
there is a comparatively low risk of duplicative efforts and a high risk 
of nonutt1ization unless the applications engineer is aware of the re¬ 
sults and they very closely satisfy his requirements. 

The Ideal, efficient environment Is one in which performers of 
restricted technological research and applications engineers are geo¬ 
graphically or organizationally associated. Thus, general research can 
be performed most efficiently under centralized management, and restric¬ 
ted research, under decentralized management. 

The value of decentralized management for the restricted subclass 
is confirmed historically by observing the absolute magnitude of the 
utilized results of technological research in the course of engineering 
development. From 20 to 3.0 percent (varying among the weapon systems 
studied) of the requisite new information in restricted technological, 
research that was used had been generated during engineering development. 




6.3.3 Kinds of Payoff: The examples of payoff from general tech¬ 
nological research form a readily distinguishable pattern. The most 
obvious characteristic is that the technology tends to have peculiarly 
military flavor—or, at least, at the time the Event occurred, Interest 
in the technology was found primarily within the Military Services. But 
most of the utilized technological research in guidance, radar and 
rocket propulsion was directed and performed by individuals who were 
concerned more with the technology than with the development of any 
specific end-item system. 

In each case, however, the performers were sufficiently aware of 
the technology's deficiencies in terms of foreseeable requirements of 
future systems. This awareness extended to the knowledge of quite 
specific design criteria that were desired. For example, those groups 
pushing microwave power tubes for radar knew more than the simple fact 
that devices with higher output would be wanted. They had a quanti¬ 
tative notion of just how much higher the output would have to be. 

In retrospect. It is clear that this'quant!tative information must 
have enhanced the realized research efficiency, if only uy automatically 
ruling out any technological approaches (even if otherwise successful) 
whose potential was Inadequate to satisfy the criteria. Examples 
(other than the amplitron microwave power tube already mentioned) are 
the hydrogen thyratron, inertial-quality guidance components, liquid and 
solid propellants, rocket-motor cases and magnetic sensors. 
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A sI ighily : di f ferent illustration of utilized technological research 
is found in the development of tantalum capacitors and high-Lpre- 
permeability inductors. It was obvious to key personnel that the small¬ 
ness of the transistor could not be fully exploited if the si/e of the 
circuil chassis were dictated by the use of comparatively large conden¬ 
sers, coils and transformers. Because these people and their close 
associates were,vitally interested in reducing ."he size of electronic 
equipment, technological research to that end was successfully pursued. 

It may be that other research engineers, more remote from applica¬ 
tions engineering, also reqognized the problem and achieved technological 
success along other approaches. If so, no evidence of those results' 
utilization was found in the HINDSIGHT study. There may have been tech¬ 
nological success, but the results were not “sold," and the research 
engineer's remoteness from the applications engineer cannot be discounted 
as the reason for it. / 

In over 93 percent of the identified Events in the technological 
research category, available Information supports the conclusion that 
continuing interaction between research and applications engineers is 
essential to a productive; technological research program. 

Incidentally, such examples as the microwave power tube, the hydro¬ 
gen thyratron and the tantalum capacitor point out a very valuable con¬ 
tribution by the technical personnel of the DoD laboratories. In each 
case, the greater part of the technological research by far was accom¬ 
plished in private industry, generally under contract with one of the 
Military Departments. The work was distributed widely in time and 
place- The only names that appear with any regularity as having been 
involved technically are those of a few Individuals from the Army 
Electronic,s Laboratories at Fort Monmouth, New Jersey, the Navy Elec¬ 
tronics Laboratory at San Diego, California, and the Air force's 
Avionics Division at. Weight-Patterson Air Force Base, Ohio. It is 
clear that these few people provided the continuity and effective 
guidance that resulted in the high payoff of technological research. 

6.3.4 Relative Value of Subclasses : It has been noted that 30 
percent of the technological Events fell into the general subclass. 

According to the analytical technique used in Project HINDSIGHT, It 
is assumed that each Event deserves equal weight, or value. This 
assumption is, in fact, valid only in the context of a c-lngle weapon 
system. In that case, because greatly improved weapon systems appear to 
be the synergistic consequence of many (usually on the order of 100 to 
200) separately identifiable Events, each contributing a negligible 
degree of improvement, the averaging process is reasonable. 

When the consequences are manifested In a number of weapon systems, 
which is the tendency in the case of general Events, the true value of 
that Event must be greater than that of one contributing only to one 
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system. Theoretically, of .course, if every weapon system anil equipment 
in the Defense arsenal were analyzed and the contributing Events identi¬ 
fied, it would be possible to assign to each Event a quantitative measure 
oT value. 

During the Project HINDSIGHT study, 20 systems were sampled with 
varying degrees of thoroughness. On that basis, such quantitative meas¬ 
ures cannot be made. The sample size Is adequate, however, to measure 
the relative efficacy of general as opposed to restricted technological 
research. Over 12 percent of the identified Events In general techno¬ 
logical research had an impact on more than one of the systems studied. 
Where this situation obtained, it was generally found that results were 
utilized in three or more systems. With respect to more restricted 
technological research, the use of results In aniltiple systems was rec¬ 
ognized in 8 percent of the Events, ai I then infrequently in more than 
two systems. 

6 . 3.5 Planning for High Payof f: Ihe many observations on charac¬ 
teristics ofuti1ized technological research arising from the HINDSIGHT 
systems study could be used to provide guidance for senior research 
management. Where anticipated results of the research are considered 
broadly applicable and the estimated cost of the task is comparatively 
low, full authority to plan and implement the research program should be 
vested jn the scjentifiic and engineering community interested in the 
pertinent technological area. Conversely, where the apparent applica- 
bilityis more restricted and the task's estimated cost is relatively 
big:-, the interests of the system-oriented engineering community should 
be dominant. 

The chief possible exception, of course, Is a situation in which 
the Initial cost of acquiring a facility for technological research of 
general application is very high. Management must then judge whether 
the application cost is properly attributable to a few tasks, or whether 
it should properly be allocated to a great number of research efforts 
planned for the future. 

Again, with this general exception, it appears that there is greater 
assurance of a high payoff from the more expensive research tasks if the 
systems-engineering community has some responsibi1ity for research plan¬ 
ning. It was observed in this study that some 20 to 30 percent of re¬ 
quirements for new technological knowledge—in the case of MINUTEMAN II, 
up to 75 percent—are establIshed while a weapon system Is being devel¬ 
oped, which demonstrates that, at present, the systems-engineering 
community cannot forecast all its needs. 

An apparent solution is to have greater recourse to the current RsD 
category of advanced development. Useful prototype weapon systems 
should be designed, developed and built for the express purpose of 
giving focus and spur to the growth of technological knowledge. This 
concept is not new. Whether fortuitously or by intention, it has been 
used to great advantage, and its impact is seen through "hindsight." 
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Thus, in retrospect the tremendous value of the NAVAHO miSsi le 
development is recognized. There were a number of reason's that the 
NAVAHO never became ope rational, paramount among which Was the appear¬ 
ance of the intermediate-range and intercontinental ballistic missiles. 
Work on the NAVAHO continued throughout essentially the whole RDT&E 
cycle,, however, and did provide a quant i tat i ve focus for a) 1 the tech¬ 
nologies required to support its development,. It is also noteworthy 
that, at the start of their development, both the ballistic missile and 
the NAVAHO were considered high technical risks. 

Studies of the technological basis for modern guided missiles (such 
as MINUTEMAN and POLARIS), aircraft and nuclear submarines almost in- 
variably’find their way back to or beyond the NAVAHO program. Inertial 
navigation and guidance systems, stellar navigation systems, flightborne 
digital computers, liquid rocket engines—all have been traced back to 
work identified as originally done for NAVAHO. 

' In a similar vein—though less dramatic and on a lower cost scale— 
a study of the history of the LANCE missile system establishes the value 
of the Miss lies'-"A" and "B" programs in the 1950s. Again, requirements 
to advance the state of the art estabiished by operational specifica¬ 
tions for these developmental missiles spurred the growth of relevant 
technologies. 

A more specific example is the contribution of the Army's DART 
antitank misslie, which was never produced. To be economically feasible, 
the DART's roll-reference unit had to be provided for a fraction of the 
cost of available gyroscopes. As a result, part of the technological 
work on Inertial guidance components was turned away from the quest for 
ever-increasing precision and focused on the need for marked cost reduc¬ 
tion. In the absence of such motivation, It Is unlikely that the quite 
reliable, reasonably precise, very inexpensive gyro used In the BULLPUP 
would have been readijy available for it and for other missiles as well. 

These examples and numerous others that have been identified 
through Project HINDSIGHT studies indicate the wisdom of undertaking 
system-development projects in a conscious attempt to focus exploratory 
development on programs of research tn technology. Advanced systems 
would then be described Tn terms of operational characteristics and 
categorized as advanced developments. Maximum freedom should be granted 
the project director to seek advanced technical solutions, and at the 
outset there should be only limited definition of a production objective 
•—preferably, none. 

In principle, the planning inputs required for a high payoff of the 
general and restricted subclasses of technological research are quite 
different. It is possible to Identify real-world problems for the 
former by examining classes of weapon systems—submarines, aircraft, 
missiles, armored vehicles—and recognizing that the growth of specific 
areas of technology is essential to the marked Improvement of one or 
more of those classes. 
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For example, it is obvious that' a submarine's depth performance is 
limited by the strength-to-weight ratios of availoble pressure-hull 
materials and by fabrication techniques. For aircraft, the achievement 
of greater effective operating speed depends upon the availability of 
thermally less sensitive skin materials, as well as better understanding 
of aerodynamics technology. To gain greater precision and longer range, 
artillery weapons requite.more efficient propellants, reduced manufac¬ 
turing tolerances In projectile characteristics, less lube erosion, and 
so on. 

Because such problems are relatively easy t«r Identify and research 
results may be applied to many systems, the inherent probability that 
the knowledge wi11 be used is high. Further, duplication of research 
can be safely minimized if planning responsibility for a technological 
area is centralized within a management that is thoroughly aware of 
general system problems. 

When the technology has a restricted application,- real problems are 
not so easily identified. The risk that random research will yield 
results that are inadequate to solve any specific problem exceeds the 
risk, of duplicating effort, and it is suspected that the work is fre¬ 
quently of less interest to the performers of general scientific and 
engineering research. In order to gain a high payoff of restricted 
technological research, planning responsibility must be decentralized 
and asstgned to the specifically interested appllcations-orientcd system 
designers. 
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7. REQUISITE LEVEL OF INVESTMENT IN RESEARCH 


7.1 Strategy and Funding 

7.1.1 Research Strategies : Every organization, whether it be a 
small company, a large corporation, a nation, or a national agency such 
as the Department of Defense, has a research strategy. It may be ex¬ 
plicit and well documented, or it may be determinable only through in¬ 
duction based on observation of behavioral patterns. Nevertheless, the 
strategy exists and, more than any other single factor, defines the 
requisite level cf investment in research for that;drganization. 

At one extreme, research strategy can call for assuming a 
"parasitic" posture, in that case, the organization allows others to 
sponsor and conduct research; then it adopts (or adapts) certain of the 
findings in accordance with Its needs and purposes. The cost of this 
attitude is measured in terms of patent fees and licenses—and, perhaps, 
in loss of competitive position. Such a research strategy Is typical of 
many sma'l 1 companies and also of newly developing nations. As reported 
by A. H. Rubenstein, 28 it typifies most of the home-entertainment. elec¬ 
tronics industry in the Chicago area. 

further along in the spectrum Is the strategy of "reaction," in 
which resources are allocated for research only to solve immediate prob¬ 
lems. Great scientific discover'es are Unlikely either to be made or, 
if encountered serendipitously, to be exploited. Radical technological 
innovations are neither sought nor expected. This conservative, strategy 
seems to be acceptable to most consumer-products industry in the United 
States as well as in some of the smaller European nations. Expenditures 
can be modest and research efforts, highly selective. Appropriations 
need only be made after a problem has been Identified. There may be 
add 111onal expenses for licenses or patents, but the probabl11ty is some¬ 
what less than In the case of the fully parasitic posture. 

' . i 

The reaction strategy, if tied to a well-planned, long-range engi¬ 
neering development program, does not necessarily incur any great risk 
of loss in competitive position, national or corporate. If observed too 
rigorously, however (as discussed later), it mitigates against the intro¬ 
duction oF markedly new technologies arid so leads to rapid increases in 
the cost of advanced engineering development. 

The antithesis of the parasitic posture is an aggressive, forward- 
looking strategy. Clearly the most costly in terms of immediate cash 
layout, this strategy prescribes that scientific and technological 


28 A.H. Rubenstein and D.E. Brewer, Research and Development in the 
Chicago Area Electronics Industry (Evanston, Illinois: Northwestern 
University, 1962>. 
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opportunities lit: .igyrc-.sively sought and, when found, exploited a*, con¬ 
sidered necessary or desirable, • lit principle, this strategy avoids the 
risk of liising competitive position ami minimises the need for costly 
licensing arrangements. Hs great disadvantage is that many findings 
will never sc*rve a useful purpose, because they lead either to undesirud 
capabilities or duplicative techniques, of which otiiy the more attractive 
alternative will be useful. In practice, the forward-looking strategy 
iii its ultimate form will probably never be adopted, because undoubtedly 
opportunities for research will always exceed ability to support the 
required programs. 

7.1.2 Strategy for the Department of Defense : The fundamental 
concept that the DoD should support some research in both science and 
technology Is not currently in question, it is generally recognized that 
a potential enemy who is technologically advanced (or advancing) repre¬ 
sents an Increasingly severe threat, and that consequently this nation's 
military capability must be continuously upgraded merely to maintain 
parity. 

The rate of the DoD's Investment In research, however, has been 
questioned. Competent authority suggests that "The high level of support 
of basic work is producing scientific and technical Information ait such 
a high rate that it cannot be effectively digested, interpreted, dissem¬ 
inated, or put to useful purpose." Translated into terms of the three 
strategies discussed here, it is agreed that the DoD must adopt a 
strategy of-at least reaction, but It is felt that moves toward an ag¬ 
gressive, forward-looking strategy will require a more pragmatic ratio¬ 
nale than has previously been afforded. This Is inferred from the fact 
that critics are demanding greater proof of value In relation to the 
current level of expenditures. 

In reality, the problem faced by Defense RED management is twofold: 
First, define a research strategy that is consistent with the strategy 
employed in relation to all RED; and, second, demonstrate that the re¬ 
search strategy defined is a sound one. The requisite level, of invest¬ 
ment in Defense research, then, will be the minimum needed to support 
that strategy. 

7.1.3 Relevance of HINDSIGHT Findings to DoD Research Strategy 

and Funding : Project HINDSIGHT was neither intended to define a research 
strategy for the Department of Defense nor designed, to defend whatever 
strategy has been used. Clearly, however, many of this study's findings 
are relevant to those matters. Further, the HINDSIGHT data permit a 
limited evaluation of balance among the several areas of technology in 
the DoD's research program. 

The purpose of thj.s discussion is to highlight those findings that 
bear, on matters of research strategy and funding, interpret ng the data 
where possible, or, where the data alone are inadequate to support a 



conclusion, speculating .on their probable significance. The logic is as 
follows: 

(1) Consider the return on i n vest men l resulting f roni I he 
strategy lhot hits been espoused by the Deportment of Defense since 1945; 

(2) Compare the DoD's research strategy with an averaged 
strategy of the intensively technological.U.S. industries; and 

(3) Examine the likely consequences of major shjfts in DoD 
research strategy or funding. 

7.2 Measuring Return on Investment 

During the period 1945-1963, the Department of Defense spent approx¬ 
imately $10 bi llion on scientific and technical investigations. (This 
does net Include a considerably larger sum that was invested in the en¬ 
gineering development of weapon systems and other mi Iitary equipment. ) 

The strategy adopted for the support of this research program can be 
inferred from several observations in Project HINDSIGHT. 

The most significant relevant finding of this study is the determi¬ 
nation that 67 percent of the RXD Events affecting the systems examined 
occurred prior to the; designing of the equipment through which the Event 
was identified. That is, at most, one-third of the work could have been 
undertaken in response to specific problems uncovered while the system 
was being designed or developed. 

This plainly suggests that a considerable portion of the research 
money was in fact invested under a, forward-looking strategy. Supporting 
evidence Is found In the definition of the RSD budget's six elements. 
Although this budget structure was not formally introduced until toward 
the end of the period studied, it served more to dignify existing prac¬ 
tice than to impose a different research strategy. 

Moreover, according to the historical funding pattern, from 20 to 
25 percent of the RSD budget has been allowed for scientific and techni¬ 
cal investigations. Any measure of the return to the nation from the 
Department of Defense's 1945-1963 investment of the $10 billion in scien¬ 
tific investigations inherently includes the measure of a forward-looking 
research strategy. 

A crude but useful way to measure return on investment is by estab¬ 
lishing the cost differential between a modern weapon system and an 
' operationally equivalent array of its predecessors. This differential 
is then compared with the cost of the science and technology that enabled 
the advanced system. The posit is that the point of marginal return has 
been reached when the cost of new research exceeds the savings gained by 
replacing the earlier systems. 
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systems could.match. I'or example, i t ,4s tne.iuinyless to'tomprirf otiy num¬ 
ber of the 90mm or I20tnm modi uni or heavy .ini iaiicrufl naileries of 
H'lb with llu> more recent NIKE-IICRCULLS missile delei.se. The gun*. were 
so IimIled wi tlr respect toiillilutlc that an infinite number t>f. batteries 
could not afford equivalency. For purposes of the returrf-on-investment 
analyses, the systems are compared only on the basis of capabilities that 
both possess; excess capabi1ity on the part of the successor is treated 
as a bonus. 

■.•OKU, because it is essentially impossible to idenlify and 
isolate the . upportod research in science or technology that contributed 
solely and totally to any given weapon system, a cost-value analysis of 
research in relation to a single system cannot, be performed. It is 
possible, though, to estimate the total DoD investment in research during 
the time the knowledge was gained that enabled the system's development 
and, men, to consider any cost advantage of the new weapon system in 
terms of a percentage of the total investment. 

The Task I studies of Project HINDSIGHT have demonstrated that the 
new knowledge utilized in modern weapon systems was gained predominantly 
during the years 19^5 through 1963- DoD expenditures for research in 
science and technology in that period have been estimated as between 
$7.5 and $10 billion; the spread is caused by"changes In accounting pro¬ 
cedures that are believed to have obscured some of the expenditures. 
Hereafter, in comparing the savings accruing from each new type of sys¬ 
tem, the higher figure will be used. 

ThiiHl, a difficulty arises as a result of various design 
compromises that have been made in a succession of weapon systems, This 
forces a certain amount of normal izatlon of system designs before ,j 
comparison can be made. The fact that the requirement for a considerable 
amount of new technology continues throughout the engineering develop¬ 
ment of an advanced weapon system indicates that the system engineer has 

no 








•s.i"i|' If. li'.n I i > ii 1 ii I v Ii-.t-l II I ln-1 .HIM- t lir 1. II i M.n -I.,. '. ii-.i i t.v». I 
. 1.1". i I if! i 111 oi a.tl i i'll) i-. Iimiii-.I in I In- A .in.I I vi'i'.inli. n! I I. I ;!) 

1 lit* i • I MM i in hi |)in .it c*. l !«• In-si peitininl I s*i I ■*■< i logy <1/1 i l.d< le in 
Id 1 ,*,. i In- I’ I <01 1 |-i-iI iiiiimiii c ili-imiM'. I ■ .lie. 1*1 ii* iiKimi.i. |h., i ,7i*ii- 

i*i:.il* li'.ll'V n.*vf lriliin.lniiii.il i n I mn.i Ii on ,u.i nmii i.i led 1, i ■ 11 .n-. •1 |;>.l| .mil 
I ‘Hi.’ ■ I imi li-.l. tniwoviu ,- liy llir ill**, i yiie1 *. 1 .iliilily to i ,1: oi t' 11„- imv. 

l. *, hn.iloijy in l lu» ijIiIit iiirt i iiim* .mil eng i nr. flu* l_*IM'*. pi-i I ».i — 

m. iiin* *.lu>w*. ili.il ininp.ir.il I vi'ly imicli yvi'iil it gains .iri* possible th'ijuyh 
.1 U'l.i I ly now ilovi* lupiiKMil pioiir.vinlli.il can exploit ,ili of the newly 

.iv j i I.lb It* I oo.lino I oijy. Comparative performance cap.ibi I i t ies of (In se 
.iircr.it'(' are *>tunvn in Kiiiuros 1/ and .IB.. 

In 1959. flic Air Force i ill reduced the C — 130 transport aircraft i nio 
service; in 196*1. the. C-IM aircraft was added to tin-, operating inven¬ 
tory Project HINDSIGHT loam.-, investigated the difference in the tech¬ 
no log i t“ 'inderlying the development of these two aircraft and eslablished 
that l ho performance character!s tics of the C-1 J l I could not have been 
achieved wi th the technology available in 1959. Through retrofit, the 
- mode I;(an upgraded C-130) made use of technological knowledge acquired 
during the 9-yoor life of the basic aircraft design. Modification by 
retrofit imposes significant limitations on upgrading, such as the ex¬ 
tent to which a Fuselage can be stretched or engine power added without 
completely redesigning the aircraft. Despite those limitations, the 
productivity of the C-130 was increased about 40 percent, and the range, 
about 60 percent. 

Where an entirely new design was.undertaken, as for the C-141, the 
ful| potential of technology could be exploited. As a consequence, a 
payload differential in excess of 100 percent and an effective range * 
increase of the same order of magnitude were nchicved. In addition, the 

C-I4l's l.£>x combat speed advantage means that it takes fewer operating 
hours to deliver a payload over a given distance, and this, in turn, 
reduces'overa11 operating costs. A very conservative estimate of the 
return on investment in scientific and technological research incorpo¬ 
rated in the C -141 aircraft may he. based on the relative operating costs 
per ion-mile capability of the C-141 and the upgraded C-130 over a 
50,000-hour fIighl life. 

Gun. iduring lirecL operating cost, system support, fiignt-crew pay 
ind > i jow.inr.e- . and depreciation, the lota i cost per ton-mile r.ipohi lily 
.1 I-. i r.naied at '.0.i'*7. A similarly adjudgeil ensi i or I iu* 

I I I 











in inni' .Hill 1 i’i h:i% 1 1 1 u| j In'lu.-i'll I'lVi ,||||| I'jMt. 

!.nil\ lilt- ii.nit III III.- i 1(0 .IM'I I. IM nil. I.ill , liMi- 

I’lir-l lii* I'l.iili-. II ii Iimi ly until-1'.I inni lh.il t In- mi-.-. i on->>! i .-nl i-d f <i -i ■ 11, 

ili.li.uliii-.li.-..nl llic I v;i ■ .1 i it l.) I I (liil.-i. f.ivi-li ll.,- |.-i )mulo<|iT.,i I 
i .l|».ilii lily In luiil.l li.it li <il Hu- .lim.ill, : In- Ail |.m<- i si i, <. |j> ,-.i !i. >n 

In luii 1.1 -..iih- nl i-.u-li ly|u* til ,ii i. r.il It, wln.-i.- siii.li <i ..I'l.ii,- 1 m>I t■ -i 

‘-I'l ivs 111.- tul.il mission ii-sponsihi I i ly Hy opt imi/inq tin; ili-siqn lot tin- 
missi.ui. In .lli«- .il.si-iui-ol technoIngy peniii I t inq (I ■«- C-I'll, hov.vvii , 
there won Kl In- no option, ..mil llii- C- I jl) 1 v c.li.i rut 11- r i s I i c*. would i-sl.iM isli 
llu- limits on c,ip.it>i lily. II c.mnol Uil-ii be. i.oik. 1 iick-d that udiJition.il 
savings would be ro.i 1 i zed -by replacing .ill C-I30S with C-i'tl"... It (..in 
only bo concluded that, in -l lie absence of the C-I'll, the total mission 
would bo more expensive because the C-130 (or iLs technological equiva¬ 
lent) would have to perform botlii the mission for which it is optimized 
and that for which the.C-I'll is designed. 

i’ :J .is - .' —/.*> HUtiri!: ■ Another weapon system studied 

under.Project HINDSIGHT was the AN/SPS-4Q radar. This surveillance and 
target-acquisition radar, now being used in the fleet, is generally an 
operational successor to the SP survei1 lance radar of World War II 
There have been other intervening radars, but. in terms of technology al 1 
were subsequent to the SP. It may be assumed, however., that tney used 
part of the r.ew technology purchased wi th tha t same $10 billion, so they 
need not be considered in this analysis.. 

At least AOSPs would be required to afford the same degree of 
effectiveness in radar surveillance as that obtainable from a single 
AN/SPS-48. Because of significant differences in the two radars' maxi¬ 
mum range capabilities, 39 of the AO SPs would have to be carried on 
separate ships, optimally distributed over a large area, to normalise 
space power density and data rates over the volumetric coverage of the 
AN/SPS-48. Let us assume that this could be done and that adequate 
communications could be arranged to maintain the distribution and enable 
the effective transfer of information. 

The acquisition cost of the 40 SP radars would be from $6.5 million 
Lo $)0 mi 11 ion more than the single AN/SPS-48, depending upon how much 
the unit cost might be reduced in view of the greater SP production. 

More important, though, 39' addi lional ships would be required, each with 
a total operating crew of some 200 and costing in excess of $15 million. 
Assuming costs of $200,000 per SP and $1.5 million per AN/SPS-48, the 
direct capital-expenditure cost of accomplishing, with 19'i5 technology 
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.m hull .ig.iin ,»■. nui li .1*. tin* l.it.il invi -, .h , irn!. in .a! I 11 m- U>>>» -.up; ! . 

i.-«-.m!i -. 1:11-1* 

lo «i iiMi'kcil i*Mt*nl , ,!nv|iri-ifilim| i-x.nn|-lf i, «,|n-« iou*.. Il.nl IIm-ii- 
not been .nk.iiii'iiu; In hnnloijy .ill .t« 1 nv, I In* spin ! rum, I hi- ■liiti.ifl 
thrv.it lh.it t*s 1 at, I i sites tin* regii! rement I t>i. tin* would i » i 

T!u* c.ip.ibi I i ty oI' the s)l>ler r.ul.ir misihl well h.ive n.*i.<.iined i|ttit*- . r .!•-*,*i.»>*-.. 
Vhe sole intent iii presenting this rad.tr example w.iv to •■nub It- vt'.n-il. 
i.'irnt the magnitude s*f the payoff of research in ,»icnee .,nd l«c!*n<*h- 
The earlier example .if theai rer.ifl. ,011 the other ii.mil, i-. .1 ram.-, m • 
Crete. real-world case. 

t'.'.* .c .The return on investment in ivseaish 

con be similarly demonstrated for each of the systems studied. To do 
iparticuloriy For expendable items such .is missiles, mines, torpedix-. 01 
other muni t ions) would involve the use of highly classified informal i/.n . 
on expenditurn-rate planning. In some cases (e.g., nuclear warheads). 
even relative-effectiveness ratios are classified. An indical.on of 
realized returns from new science and technology in some olho* systems, 
however, is suggested by tin: ratios shown in Table XXVI11. 

Table XXVIII. TYPICAL INCREASES IN RATIOS OF OPERATIONAL- 
EFFECTIVENESS IMPROVEMENT ENABLED BY 
TECHNOLOGY 


Estimated factor of 

We apon System__ _ operational improvement. 


Current.________ _____ 

Predecessor ______ ___ 

in a common role 

M-10? 105n*n Howitzer 

M2A! ITtma Howitzer 

1.1 

Mk 4f) Mod 0 Torpedo 

Mk 'M Torpedo 

12 . n 

Mk 56 Mine 

Mk 10 Minn 

10.0 

BUI.I.PUP ASM 

Free-Fal ! Horn!- 

•i.-n 
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S’# ,i Imi nt’-l:that bettor m,iiuHicroe.nl might. have .resulted in ct|u<il a-1 uni'. 


• ri»'i ,i. Mil.) (li>r inyostincut . One veiy inisiniiuiful lest of t in.' ;«loqu.ii.y ol ■ 
'*i.iii.Kioiiioii l is. offered by the HINDS IGIIT ri.il ;i. 

Undoubtedly the (wo most iti If • cu11 rieiisicms that must lie made by 
I’M.i.iijors of the DoD research program involve the total numlx: > of dollars 
to bo made aval luble for research each year and the relative apportion¬ 
ment of • units among the competing sciences and technologies. This stu<)y 
doe- not extend to a direct test of the wisdom reflected in total dollar 
level-.. It is possible, however, lei estimate the quality of judgment 
exercised in apporlionroents. One might then Speculate■that, because the 
same people were involved in both Sets of judgments', the wisdom displayed 
wa* about as good in one as it was in the other. Also, an indirect test 
of the reasonability of the total dollar level is presented In section 


in Table XXIX, many of the sciences arid technologies shown in Table 
VIII are listed in relative order of funding during FY I966, Some items 
were omitted because the systems in which those technologiesWould be 
important we 1 a not ■ represented by the types studied in Project HINDSIGHT. 

Table XXIX. RELATIVIi FUNDING OF SCIENCES AND TECHNOLOGIES, FY 1966 


1. Missiles 

8. 

Physics 

?.. Navigatier and 

9. 

Mechanical and civil 

communications 


engineering 

3. 

10. 

Materials 

a . f (*':r, i■- 

11. 

Mathematics 

!>. • t->,el 1 I 'ts and fuels 

12. 

Chemistry 

'■ nnil:.: : 

13. 

Atmospherics 

/. it tiii'i uiri i-tj'i:|»uont 

14. 

Energy conversion 
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Will; to ll»r i|l|i.ilillt iy nv<'it llllili-tl liivig.it imi ,iml it .1 

(i*-n. li-tiitiol , i Vs, sou-t.il Lit lui’i must In- < mr. i >l< i rd. lii-.i, I: 

*.v*.Ii*i-i -.ludi • that tolit-d (in those n-i-liiiuliitiif*. w.I-, tin- Mivig.it ion 
Satellite. (Ui.(l only the piloting pur I iiti ol l In- system -.ms c/.iiiii im-.I, 
Nest, ri.tjor ,1 ‘Kmikvs in iht»sc nn liuolngii ,il .ne.is |hi*. Iil.ili-tl iim-.l A 11 - 
• I init' frame 11 -di'i -1<06 i) wi ll which Pinjeil H I NDS HUH is comet tied. Mu-.. 
.illiKtinili lor tit t feting i t-.i-.on-., Ilk- HINDSIGHT data do no I <il Im I .in 
t-.jit-t i.il U- %|ihhI lest in • ho cost- ol t-Icc!routes, titatei i.ils, ' ii.wiq.it ii-i 
oi (.iinim'mi c.il ions. 

It is possible th.it tills purliculjrcoclficient of rank cot t cl.it ion 
-Measures ,.i ci icuilous ly sol f-serving phenomenon; that is, os a ronsi- 
guniuv of lit-.ivy funding, t.lu-re have boon more uccump 1 ishinents in curtain 
.iiii.it of scit-nco and.technology. Undoubtedly.there must be some cor re- 
I .it ion bet wool! level of funding and probability of successful achieve • 
rit'iil : to some degree, there is a resultant bins in the HINDSIGHT da to. 

In general., hawevoi, the approach used in this study—the retrospective 
tracking of the flow of science and technology, starting with mil i/ed 
rather than laboratory-advertised products of research—serves to mini¬ 
mi jo tlie consequences of the bias. 

To the extent that managers of DoD research dictated the nature of 
the weapon systems to be developed, they had opportunity to encourage 
the use of their programs* results in those systems. Wherever the 
weapon system was developed by an independent agency, such as an indus¬ 
trial contractor, the opportunity would be minimum; and that was the 
situation with respect to almost ail the weapon systems studied in 
Project HINDSIGHT. Thus, the rank correlation does measure the quality 
of managerial judgment in at least the matter of resource allocation. 

As previously noted, a coefficient of rank correlation of 0./ would 
be “high." ignoring the possibility ol logical adjustment to 0.;V3 as 
described before, a correlation of 0.83 is enough to demonstrate th.it 
management has done an excellent job of allocating its resources amni.g 
competing scientific disciplines and an-.is of technology. 


'Correlation significance tc-si 
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Certain .i'i|iiu'n l •• ul 'll.S. industry, •• i I In* i v<» I mil .11 i I y ijt li».ir 
liki’l-.' in i esponsi* In I !v tiiiiMl ol i e«n| J • ■ t i I iuu in .1 f i;;.i rl- r| , l-.a/i 
• l.I.ipU-.i .) r.-n.Mi it • loi>ki :h| ivsimii.Ii si iv.|«*»iy.. Hu- .iivo'.ij.k.i- , C'>i , i|. , ili-r , 
ohn ri-rjcon t i i_m l. pot rochomi cal and oilier simi l.ir ■ businesses' i f n i tl.i- 

iislinologicjl ly intensive segment of l lit- nu lion's industry. Sew*: 11:- 
ii.ini-. into lliose 'fieIds have 'succeeded and grown; others have f.ijli-rl 
uni disappeared. I t is reasonable In postulate Unit research . I r».i(• • «;y , 
including I is I'liinliiui aspect. lias been a si gn'i fi can l fact or in ! li« • sur.- 
»»•••>•> or failure nl‘ i mli vidua I companies. In any case, it is difficult 
lo challenge tin' wisdom of strategics .employed l>y commercially success I ul 
curtpehies. 

In genera I . companies that arc deeply involved in techno logical 
activities unis I maintain aggressive research and development programs: 
the marketplace holds a continuing challenge. The Department of Defense 
is in a truly analogous si tupMon only when international peace is in 
se.r : ous danger. When there is no immediate threat tonational security, 
it may be possible to curtaiI or postpone the development of new weapon 
systems until, ps technology grows, opportunities for even belter weapons 
arise.- If/the DoD research program i s.maintcii ned at a heal thy level 
during those relatively peaceful.t^mes, the balance between research and 
development should shift away from that adopLed by industry. In brief. 

?'• fit : .!-n :■!:<>:>, •/..•'y.t' to th<> liut-f.iruf .y,r. 

• • ■ ',7 iwr; yt-i-i'i'i: hii'llu: /•'ly'.'ot .".'.'-.' , 

■■■ jn.-'il i.’uit of b.'ithnolCo va..;/./.;. ft:!. 



>1 fc*v; decades tlu* national security ht 
The allocation cif DoD resources betwei 
meaningfully compared wi th that of tlii 
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Indust rial 








On .in .ivei,li|f, I id t In' ye.tt •. tiuni i*l6>* Iliiiiinili I'jWi, .'-lli.il 
• •■I’.” i«'il applied n'MMiih I.in ,ili»ut I .h tiim". i|,iiMti'i ili.m Hum- i.- 
!>»»|||‘»! -I " i*\pli>l.ltoiy Iil|JHK*Ml•. I Ini'. , I In- *1 pt-rti-iil. .in.I lln- I'J |..-i 

vi’iil t »*i Imsii ,imi. ,i|i|i I i oil icsi'.in.li, i ■•.••pi'i i i w«* I y, I r.in*. I .it •• I u 6 |,i-r« >-i.i 
ot lln 1 Int.iI KM) br*tU|i»I fur iv.tMiih .mil slightly hvi*i I h {>■ ■ t't • -n! |<n 
e\pli»r.m*ry development . 

lUili/imi Dol> strategy as a base for calculation, Table XXX display'., 
lot fiscal years 1962 through 11)6/: 

lho reported Dol) apportionment tor total Ri.U (column ?); 

. the approxim jornti lures or allocations fur research 

and exploratory dcvclopmc.- jlumns 3 and 6); 

. . the levels that would hove been assigned if the overage 
industrial funding strategy had been invoked (columns 4 and 7): and 

the percentage differences' (columns 5 and 8). 

Apparently the Department of Defense has adopted a more conservative 
posture than industry with respect to research and, until recently, a 
more aggressive posture concerning exploratory development. 

Difficulties if) reconciling the two sets of definitions may be 
responsible for greater apparent differences in this table than actually 
exist—that is, the DoD's definition of research may be more rigorous 
than industry's. The consequence of that difference would be a mis¬ 
leadingly high industrial figure for research strategy (column 4) and a 
correspond Ingly low figure for exploratory development (column 7). 

v ". - '''•> of ikiUi on Science Hcnourcee. (Washington, D.C.: National 
Science Foundation, NSF 66‘33i December I966) , p, 9, 

' 1 :; a.- rlcc.saMkj Applied ii -.uwch, a»! !'c;n-L pa x! J 
•’ (Washington, D.C.: National Science Foundation, NSF 66-28, June 
I966). F- i'-mL Pwdn for Rcsuxiivh, lkr,)<;lopi%’tlt .lit/tV»:■•»• 

I'? ):>•?!.•, INK, (Washington, D.C.: National Science 

Foundation, NSF 66-25, I966) , J_5. 
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. I j;;n >■■■-■ l«. 

!•! I,|fl'. 'ii*. 
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Mi i,Mil r,nxij- ; 


ill lilt a I*. I 111 I it < ll .sllil !•/>•,. H.l 
!.>i*. .It-vi* 1 > •jin;. • n I i, ■i>il> i iii-ii •impli". I •. I ll. 11 the Doll's iiivrslwclil in I' / !i !..r 
vuvM I r» »nt v/f i,i ( I In- .ivrlaue iiulu.lii.il 11 alegy won M tlic t.ili- by a dit 
11’ i rinr i.inging I'm nil a lii<|li ul lt.fi prrirni It; .1 low of -■/ .fir pt-i n ill . 

Ohviniis ly, tile analogy between 11>»* Department of Defense and inn. y 
Iis is not good rni>ii(|li |«i permit using this analysis for iikhc IIi.iii ,i 
rough t iuu k. Cninpt rssed I iini' schedules for weapon-systems drvr Inpiin-nl, 
higher development costs restil ting from system specification* lot cx- 
t I'eine degree-. of in. i inl.ii ngbi .1 i ly .mil if 1 inbi I i I y, and the like, eoml-. i 
in err.iir .i situation in which the Doll's apportionment wouldbo shitted 
ntinrwh.it iIohm - to development than is necessary in industry., This 
■•hill sli'.iiild hr pari ly-offset by the foci that i I is more important In 
ensure the survival i.f The nation ‘.hon of a single company; and, the re¬ 
fine, I he Doll sin tn I ii adopt; an. even more forward-looking research strate¬ 
gy than I hr most technologically intensive industry. Novel llieiess. the 
analysis dors demonstrate that the level of DoD expend!fuies for research 
■'ii sc irnce and-technology has'not been significantly out of line with 
what U.S. ■industrial strategy would prescribe in ah analogous eiivi ron- 
pibnl . 

/.:> hConnm ies of a Forward-Looking Research Strategy 

In the preceding section, it was noted that the Department ol 
Defense evidences a forward-looking research strategy and further (with- 
i"l tl'Miiiiiisl rat ion) that such a strategy "can be the most oflT’clive and 
i' ir ten I of | lie several possible a I lei nat ives described in sectioi /.I. 
r indi‘ii|s T»l i he HINDSIGHT s I uily suggos t that . if a steady increase in 
weapon sysi (‘ins 1 performance or cos I -of feet iv**.ness is sought , the only 
Way I• i avoid a rapid escalation ol research cost is to adopt an agies- 
,iy.>, forward-looking research strategy calling for a cons i tie rah Ir. 

■ iii»Min' *.l hi'ihly speculative research. 
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1..II i:v! y oil cm 11 no ol I lie 10 sy Meins Ifi.iii nut . 

I n .I’iiiurc 1-9 , the evl i nulled imp rovi miic nl 1 actor lor the produce, vir- 
■.iiitfssnr pairsis plot toil ugainstn measure ol .tike predecessor 's tech¬ 
nical, sophist feat iim as a function ol the number ol RXD Events; requi red 
l>i ai lain lln* more .iiivanced successoi sy.leia. "Improveinen' l.icim " i• 
delined as the lalid pi the successor's cost-effectiveness to that of 
the predecessor. (Moiv rigiu'ousjy construed, it is effectiveness/Lost: 
el feetiveness/cost.) The sophistication of the predecessor is assessed 
.in terms of cost per pound of the production model. The particular 
function of the number of RXD Events is the luyd.ri thin to the bas'd 10 of 
the number.. ■ * 

Intuitively, the mathematical formulation expressed in the plot 
appears reasonable. Experience tells us that generally, as an equipment 
becomes more complex or sophisticated, a greater amount of effort is 
required for each successive increment of improvement. Analytically, 
that experience may be rephrased: The improvement factor is proportion¬ 
al to some nonlinear function of the added complex!ty or sophistication 
of the new system and to the level of complexity or sophistication of 
its predecessor. 

For the first-order approximations permitted by the available data, 
it appeared reasonable to assume a logarithmic relationship between 
number of RXD Events end improvement factor. (The reasonabi 1 i ty of this 
assumption is supported by the fact that the data fit a straight line 
over a range of departure that exceeds a factor of 10 on the vertical 
axis and a factor of 30 on the horizontal.) . . 

Figure 19 provides a means of speculatively demonstrating the level 
of research costs that might be expected if the Department of Defense 
were to employ solely the strategy of reaction In its research activi¬ 
ties. Assume, for example, that an improvement factor of about 60 per¬ 
cent is desired in a solid-propellant, incrtially guided I CBM. From 
Fig' re 19, the factor, "complex!tyX logjQ No. RXD Events," is seen to 
be 0 07. I nowing that an ICBM of the current generation delivers for 
roun.-lv $40 a pound, a requirement for close to 1,000 scientific or 
tccii.iolbgioal advances is evidenced. Now let us assume (very conserva¬ 
tively) th.it, on the average, we can expect full success in 25 percent 
of our research program. That is, of every four ideas tested, at least 
one will hr found worth pursuing. 
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«‘n-.niin| •.! lii.it ion might be i.>«ii|iIdr Iy di! I«*ioril . 1 <> 11.«1 »• ..-lid 

-*ii>|ht ikiiii , Kim'iI on oxjwrifiHi*. I»»l u% lntik.il ,i >lj 1 IimViiI c/.iiii|iI> 
Operjt ioiuil ly,the Starlight Scope, a nigilt • i •« itm ilcvii *,tu>liv.) i i, 

Priiit'd niNOSIfilir, replace*. the /x'jO hinouil.it''.. (llivou'e.ly, it i% ■</.! 
mil i* **l> Unit any amount ol improvement in tin* opt ii.*, <u »■( Ii.I 
structure of binoculars could match the new device's light .wipl i l• * al j-,;- 
capability. Nonetheless, assume that, i nsluatl of introducing I I / 
new techniques based on results of some; spucul.it ive fese.tr: 1«, if ».»*. 
desired to improve the binoculars. 

Working through Figure HI and using the actual improvement l.u »oi 
Iwhich is classified) of the Starlight Scope over the binoculars, one 
finds that, again, about 1,000 RXD Events would be needed,': as compared 
to the less than 30 Events that were actually identified by the study 
team. 

Another example offering comparable numbers is the Navigation 
Satellite with a "much Improved" ldran radio navigation system. 

Admittedly, both examples are specious; but they do make the point 
that marked operational improvements In sophisticated equipment are far 
more likely to be achieved at moderate cost when completely now tech¬ 
niques are introduced than when the ovcral1 improvement is sought 
through the deliberate refinement of each technique used in the prede¬ 
cessor equipment. 

These simple cases should demonstrate beyond any reasonable doubt 
that an aggressive, forward-looking research strategy with considerable 
room for speculative research is essential if weapon systems are to be 
improved on the basis of neW Science and technology gained at minimum 
cos t. 
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/. 1>. I l’.i\ I'll 1>I ■ IV'iiMi'il . IIIVI*-. lnu-nt : IVl.iil.ii ! intj , I imi I. 
niMI'.'ii -.v.li'ii I‘Ml iv ■ 1*1 ‘.ivliii til. lilt ly impl iivimI (l>y .1 1,11 I in nl I 'll 
•'ll 'i v* I * *s i' 1 1 purilri i’-.mii . >.y. I i'll tli.it |«-i III 1 Iiu-it .1. iii-iif ■. 11 I y 'iinil.ii i S I - 

l.n\ ; luiu I itin icvimI .1 Tuniimiii pal Iv.i.i'. I. iI.illvly I'.r.y In. ■ ’ i 

k'ri 1 \>i sum nl 100 tn 201) M ion I i I. i 1 «>i . tri.hnoluiji i .Tl .nl'/.iric.". lli.il 

coni rihut 1! to. the imptovod poi loniumcr til the IoIim *.y.loin. lypi t,.j| I ■/, 
tile poUMili.il ciiif.oi|iicnCi* »)t .my inij le t. v>*u I . i\ liivi.il.. It is, 1.11 Its ■ s , 
llit' -tki II I’ul inti'ii ra! Ton nl' in.iny advances lli.il gi vr-. tin- new syM ism it', 
greater operaI ioii.il Capability. 

A numbei of the advances — usually in teCnhoiogy and typically ghoul 
h.il f of those Mi'iUiTioil;through a s ingle syst eni study—arc not obvious 
ly. contingent .upon -any other reconI advance. The relevant science: i.*, 
old; tlie material* and fabrication .techniques requireu ^lo implement, the 
■idea in. a useful ..form have boon available for spine time. Apparently . 
independent of anything else, these advances could occur at any lime; 
and undoubtedly the ■frequency of I hei r occurrence could be accelerated 
by the infusion of more money into R&O programs. 

.The other half of the Events, however, are clearly dependent on 
other recent advances in science or technology, very often (as noted. in 
section 5-I•I). on new materials. 

It is the latter group of scientific and technological advances 
that provides the pacesetters. Because they must. : be sequential in time 
(each conceived, its validity tested and demonstrated., and its existence 
advertised before it can be used), it is not obvious that increased 
funding wi j I signi ficantly .has,ten, the realization of, advanced weapon 
systems. . . ■ ^ . . 

Moreover, to the extent that current management may be less than 
optimum, there may be unnecessary delays in making resources avai lab Ie 
for testing ideas or in advertising new scientific or technological capa¬ 
bilities. This, however, involves the management oT avaiI able funds: it 
doesn't provide an argument; for additional funds or indicate that addi¬ 
tion; 1 funds would offer any particular advantage. 

Next, as noted in the findings (section 4), a significant number of 
RXD Events occur during systems development and respond to problems that 
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tin.illv.il imr.l In- I ei..-|ni Ih.it Iln- |».»y«.M <>t • i-i »»jh »I 1 

i Mils is in I hi* system til.11 ii -Alii li.t 11 y dev. hijn-il, nut in !*•- :<«-• 
tH*I.n|\ ilsi’lt. At'(i'iil.iji'il I ei hiu»Ii»| i i .i I •|i<n.-lti i •. jimt i 1 ..1.1«- nnl,- .1! . r 
.u lomp.inied l-y .1 1 e.i.liiirss In undei T.im* •**.»;■ ne.-i iii«i «li-v<'l»i|i*wiil -i! •*«• 
equipment Ih. it will ns. lh«* m-n ««-i him logy. Oiu'e lh«- 1 .-.i I i/. d ... 
svsU’ins s.it i sly upoi itipiMl iequi leineiits, Iln- point nl >!i.it<|ii:.:l *«-;••»»»' 
i.n investment in systems development—.nul »oin.omi 1,1111 ly on irv.--.iin-i-l it- 
st-ioni i iiml U’flninhHjiv.t! iese.inh—inr. i»ee«i i.-.h.ih-.i. 

In brief, tin* criterion fur the lese.iich program's si /•• iylittv-il r»n 
tin* needs of fnt ure weapon systems uiV.I btliei mil it.ny equipment , which 
in turn are defined by future uper.ition.il lecjui rcmenls. hi; the absence 
of identified future operal iort.il requirements th.it c.in lie interpreted as 
,1 need for doubling the research budget, little gain can be expected 
from such an action. 

7.6.2 Acceptability of Reduced Investment : The answer to the 
second question, "Would a 10- or 20-percenl decrease in the annual 
investment still bring an acceptable return?" depends upon intentions 
regarding future system developments. Assuming that the replacement of 
weapon systems will continue on a roughly 10- to 15-year time scale, a*, 
noted in the system studies, the data suggest that any decrease .would be 
unwise. 

First, it is to be expected that a reasonable percentage of the 
replacements will be markedly upgraded versions of the same systems. 
Figure 19 demonstrates that, for these cases, the research budget should 
be greater than it was in the 1958-1963 period, in which about half of 
the new technology used in the systems examined was spawned. 

Next, as Figure 14 shows, 33 percent of the requisite new science 
and technology Was generated after the using system entered engineering 
development. The need for many of those RXD Events could not reasonably 
have been anticipated before system design began. A considerable por¬ 
tion, however (perhaps 20 to 30 percent as a rough estimate), could have 
been foreseen and the necessary research undertaken if the funds had 
been avallable. 

With the advent of advanced management systemsfor procuring 
weapon-system development and the requirement for detailed contract 
def ini t ion—along with insistence upon the use of fixed-price develop¬ 
ment contracts and the introduction of incentive contracts calling for 

ly M. Mcycson, "Price of Admission inio the Defense Business,." 
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•isiiiqU -of Ion. «i port i iiu I.ii sol of c i r cuius tantes was found 16 ixi'.t 
a lo.illy now idea was introduced. In each case, the judgment <d 
ini.ted nut lun ily was tfi.nl the i esoarch proposal offered' | ess pi om i *;t* 
anotlier, more popular one.. The situation was sufficiently aggra- 
I that the less renowned individual found i't necessary to establish 
Mle ^.laboratory facilities and seek new sources of funding to pursue 
dens. Interestingfy. in at least four examples found during Project 
ilf,HT. Lb.* new idea eventually resulted in a dominant technology. If 
mob Io cos i.-effectiveness criteria had been enforced, it is 1ikely 
those new technologies would not have become available. 


In retrospect, the difficulty of fairly appraising a new science or 
an untried technology is apparent. The basis for judging either cost or 
effectiveness In those cases—to the extent that the situations can be 
reconstructed—would not have been adequate to warrant supporting the 
research. 


Multisource funding is essential to the continuing encouragement of 
new ideas arid the maintenance of viable technology. This situation is 
not compatible with detailed cost-effectiveness previews at senior man¬ 
agement levels. Clearly, in view of the magnitude of the research ef¬ 
forts discussed here, discretionary expenditures by laboratory-level 
management arc essential. 

The second pertinent matter suggested by the HINDSIGHT data concerns 
the typical amount of time that elapses between an idea's conception and 
the beginning of actual research on it. The median delay appeals to be 
.1 few days. The average delay Was 3 to h weeks, a few very extensive 
delays iccounting for the big difference between mean and median limes. 


On the basis that this was only a sampling ol Events, the tentative 
conclusion is that the processes of research in science and technology 
,irn generally inlolniant of extended delay. Presumably, unless resources 
nr" quickly made available, the originator of the idea turns to other 
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I - 1 «■ -.’fi-.ii li-i-it! fl I'tlfir.i- h.r. ..pi-fti ni.iny •» i I Imif. >.| i-.lln-. .it ..1 

'>• • . t v l •>. • I. -i|y .himl.I In- ftjii.ill, m-.i'IiiI it. ..it/ .it|ti.t / r 

l'u‘ .ii>.1 I > •. i •, 11 1 i n! inn i|.il liri ini Ity l|n* II IHiJ'. I hill -1 |jt.<.i<. i . j 

(MlI ill uriIy in it in", til t-.n li 
•my whii-.i- (itjji-i l i y.- !•. II,f 

irm y Mi.il i •. if. I i U ltd n. 
t!ii’ use ii| i ii'ii'.i i’i li prurliii-1 s nun Id inu-rj} ivi "urn! i i i-ci rd li.ivie i i.i'if.iri li" 
di l remit l\ . 

Since Project HINDSIGHT began, iliese 'sUidii! 1 , hove been given a 
■.on-. i.leub le amount-,01" exposure to the. U.S. sc-ien li T i r. and IrChnoltigi cu l 
vv-Hihium ity, chiefly III rough the publication of formal pope is ami inquiries 
by interested people. As o consequence, ,i number ul" questions liiive. been 
raised and critic!sins voiced about re J 1 or fancied weaknesses qi the 
methodology. At the same time, participants in the studies have.also. 
be*>n concerned with me! kudo log i cel validity. For that reason, the most 
obvious suspected weaknesses and those that could be most significant 
are analyzed here. 

. I Pi fforcncc. in investigators 1 Abi I i ties 

Even though a reasonably succinct definition of an RXD Event was 
established, the investigator with the greater sensitivity, experience, 
interest and diligence would identify more Events, He would also more, 
readily appreciate that there may be several Events in a scientific or 
technological advance that a coworker might consider represents only a 
single Event. This, methodological-weakness was circumvented to some 
extent by using teams of 5, 10 or 20 investigators on a single, system, > 
and this provided an averaging effect. 

More important is the fact that the total study is relatively in¬ 
sensitive to the exact number of Events found in studying a given system. 
In cases where only one, two or three Events were identified, the value 
of new research findings to weapon systems might be suspect; or the 
evidence could be Interpreted to mean that a very small but- sharply 
focused research effort might suffice for the future. In the range of 
20 to hundreds of Events j however, particularly, where a great diversity 
of the utilized areas of a technological or scientific discipline is 
noted, the evidence clearly denies the potential of a limited research 
p rogram. 
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In this end, thi* iHuillHM ui I veils .utu.ilty icle.it i l i t-,1 piM sy.tce 

may be assigned a noimaI i.*im) .mult Ipliei l.ultu bused upnn tin* study 
team's estimate «>t the lliuiumjhness pi its envelope. I'/i'i- section 
*1.1.2.)' ‘thus, lor the C - i*i I ei ret ait study, a mu I ti|> I in ol may In: 
used, wi tli >,J) for the 1AHCI missile, I.OJ» for the Hark i>G mine, and 



A sampling of all RXtt Events, rather than an exhaustive study, 
tends to mitigate against the expectancy of a high degree of experiment 
repeatability. That is, if a different team were to repeal the study of 
a system—particularly one like the C-l*il, in which the Sample studied 
constituted about 20 percent of the Events identified—a different set 
of Events might be found. Conceivably, that could introduce marked 
differences in the distribution of factors discussed in section *t, 
"Principal Findings." 

To measure the probability that different groups of technically 
competent investigators would identify significantly different Events 
as most important to a given system, two separate studies of the Hark h6 
Torpedo were made. One team investigated almost h0 percent more Events 
than the other. Although the larger sample still contained less than an 
estimated 70 percent of the possible Events, it included approximately 
90 percent of the Events studied by the other team. 

More important, however, distributions among such matters as funding 
sources, research-performing agencies, Event costs, etc.. Were essential¬ 
ly the same. In retrospect, this is not surprising, for, without regard 
to the weapon systems studied, these distributions remained sensibly 
constant during the time the HINDSIGHT data base grew from 100 Events 
drawn from seven weapon systems to 710 Events from 20 systems. 

8,3 Basis for Invention Claims 

Another question on the study methodology Concerned the teams' 
apparent wi11ingness to accept claims for inventions in the absence of , 
patents or other documentary evidence. In terms of the Project's objec¬ 
tives, this is not a weakness; and in some cases the investigators in 
fact doubted the absolute validity of claims. If the identified group 
was really not the original inventor but honestly, thought it was, as long 
as management agreed with the performing group, the environment in which 


128 












C.in icquiiv ?0 years or more, ,is compared to about nine years foi the 
d i roc t oil basic resoji ch. category.. Since the focus ol Project HI NOS I CM i • 
w. is on l!u\ post-19*1 b pt-riod, it is acknowledged that full recognition 
lias not been given to the long-1unit growlb of scientific knowledge, the 
reader is reminded that the strotegy. adopted, in HINDSIGHT, as described 
in the Executive Summary, included determining to wliut extent performance 
Icost-el feet ivoness) of .new weapon systems was dependent on recent ad*" 
vances in science and technology. Therefore, no valid conclusions can 
be drawn from HINDSIGHT concerning the long-term value of undirected . 
basic research, since many of these important events fall outside the 
t ime f fame of th i s. s ludy (19*»6-1963) * 

6,5 Investigation of Failures 

Project HINDSIGHT'S methodology might also be criticized because no 
control group has been established; but. fa I lures are extremely difficult 
to define, and failures or unutilized RXD.Events have not been investi¬ 
gated. 

For instance, although it never became operational, the NAVAHO 
missile was a most prolific, source of useful technology. It appears, 
therefore, that profitable lessons regarding poor research management 
cannot be learned from a study of unsuccessful weapon systems. Research 
is undertaken in the quest for knowledge, and the disproof of one hy¬ 
pothesis may be just as important as the proof of another. Thus perhaps 
only inconclusive research may be classed as a failure. But the diffi¬ 
culty Of discriminating between inconclusive and incomplete research is 
a delicate problem that is well beyond the scope of the teams identify¬ 
ing RXD Events. . 











• •’i llii- line being, i I j ■. iMi.ly i il«* I.. •. .• |: i. i -. . ; , • > . 

1 ' •'•H >>•••. i i| | \;i III ili-lK'l .1 I |*<. I i i i • ••. .1-. tin- .ill.lt/-.I-, ,|||.I,-| I...,. 

,|||,! -II'IM'1.11 ion ot m-u knowli;li|e, ye I ml mil fi.iit.»)• 
lo.nl Mw-ii.i I ho <iro.il oi ... n| liimlimi .. . i,.. | . 

■Ui.iiii, pioituoraoiil politic’, iol.|lini| to ut-.ip<ai sy-.ler, ,|.-/ ( ;..pe.■ . 

•HO Kims: on I lie assumption tli.il .ill'the io<|iii-,i l. l.< in 

.vni ill,il iSM’iiii.il |y , 1 11 tcolinii'.il pinhlorr. i.m l.o tlisunn-ied in tin 
, ,m<.<‘i>(- loiiiml.il ion end conl r.H I-ilcl ini I inn < y< le. Ifm oviilciiii- ih.ii 
:o JiO poneiii »( (lie now knewIedge i*. generuled .liter the divi’lnpivni 
contract is.iw.ndod inv.il iil.ilcs I li,U ussumpI lull. 

More subtle conclusions must await completion of I lit bucoml l.j'.f 1 . 
!*.o Bi.e . of I lives t iquturs 


Despite the advantages of using senior Irik-house Defense personnel 
to identify RXD Events, there was concern over the possibility of hij* 
on their part. As a consequence of their primary jobs,'these.’people 
have a personal interest in the DoD laboratories and might be expected 
to picture their parent organizations in the best possible light. This 
undoubtedly tended to increase the number of Events identified as occur¬ 
ring in the DoD laboratories in ratio to those originating in the univer¬ 
sities and industry. 

A counterbalancing effect via s noted and described, however, by some 
of the weapon-system study teami. In the Words of the team captain on 
the MINUTEMAN II study: 

It must be realized , . . that industry is much more ready-to 
answer government solicitations for reports of contributory 
research than even government labs or universities would be 
because of the profit motive. Industry was, : in most cases, 
happy to supply our team with reports to show their research 
contributions to MINUTEMAN; whereas government labs had often • 
changed personnel and did not have either the time, the his¬ 
torical records, or as great a motivation to show their remote 
and Indirect contribution to MINUTEMAN. Industry’s contribu¬ 
tion was more directly applied and mon- easily and quickly 
obtained from records. 
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. Probably tin: most serious drawback in Lhis approach is an inhereu 
>ius. in the typos of technical accomplishment uncovered, an uneven 
distribution' Ur.it can perhaps be eliminated only by asymptotically ap¬ 
proaching completeness. Thus, during this type of study, a typical 
vrderintj may be as follows: 


(1) Engineering achievements involving subsystems and major 
components. These were treated as "elements" or sources of the type of 
Information sought. 

(2) Specific creative activity in design engineering that h; 
the effect of advancing the state of the art, is frequently patentable 
and js essential to meeting spec!fications. Such activity Has been in 
eluded wi thin the class of RXD Events in spite of its a-iha; character 
since there seems to be no good reason for excluding it. 

(3) Exploratory development in materials and materials 
processing, which is characteristically performed by industry. 

(it) Other exploratory development, also predominantly 


(5) Research performed in industrial or government labora¬ 
tories in the United States or abroad that led directly to exploratory 
development. 

(6) Research in universities leading to exploratory 
dovelopment. 
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o Arthur l>. I.iulo, !no. (I June !')•»•>), copies of which have t>i«- 
novided to your office, have shown the fc.iuibi I tty of a uiclliml o 
oriial aiu I vs irt will oh Is based upon tiro ideiil i I' ioaLitin in weapon 
eras of tlio most Significant contributions Tromroscareh ami capI 
lovolppmoiif (RX1) events). These RXI) event;: can bo analyzed, as t 
»I lot studios il lusLraLi*, so as to identify management 1. 10 tors wli 
ippear to bo associated with their utilization. 

V broader data base • Linin' tliuL provided by the pilot studios is lie 
ituiv firmly establish, or perhaps disprove, Clio hypotheses made L 
In addition, a broader data base has Lite possibility of providing 
iorl of quant.itat Ive. measure of the overull payoff to weapon syst; 
the Department of Defense investment in research and technology. 

finaliy, the report of the House Committee on Defense Appropriati 
(Report No. 528, 17 June 1965) has questioned both the efficiency 
nanagement and the overall payoff of the Defense Sciences part of 
RDT&E' budget. 


.me has coma, therefore, to make ot 
la lysis of the impact of research ; 


1 priori tv bar 
1 technology c 


I number of Important weapon systems uow in use, in pre 
1 Liu* advanced stages of engineering development. Tills 
( 1 ) to identify and firmly establish management Tacit 
id teelinolngy programs wliicli have been associated with 
1 of the resuJLs produced by these programs; (b) to mo; 
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w.Mjii.n :i\-ili.»i!i, with i goal «»l .11 I ••.»:: I .1 Viilimiii.il.- i.|n.il 
1 , I’lm*. K.i«’l» Hi If 1 .it v IVp.irlttUMil will be .i:;k«-it t |>i nv i,i>- 
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i-ivi IJiii 
ini-il In Ai ■ .ii'liiiu-iil I. Tin- 
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Hv designating l lu> pari it* I paid:! .is Ili house, I expert that I lie n.i |m i | ■; 
will in’ limn Moti l.iUiralories., am! systems' .’iiginn'iin,-, .mil M.-iiiagciu-iiL 
organ i.*.al ions, ;iI though part lei|i:il ion from tlie* spri-ial imnprol il orgaul- 
,'.at tens will lu> encouraged i»i arras where tlirir expertise is needed. We 
wish, . however. to exclude contrac! or organ l/.al ions apeel firs 11 y liirril lor 
this task. 1 believe the; iu-hoiise and special nonprofit groups wi 11 do 
a hotter job than contractor organizalions because (a) they liavi liro.nl, 
relevant experience,. (b) using the method of lorming teams, people with 
special iin’il experience can be milt c. hod to particular systems, '{«’) they 
have more ready access to Lhe necessary inrontiaHou, muc.li of which ina> 
he proprietary, and (d) the educational value of participat inn will In¬ 
substantial. The lasL point Is particularly important since one of the 
primary goals of the project Is to formulate new.or improved policies 
Cor managing research and technology programs. 

l will appreciate your giving high priority to requests for people aiid 
for oilier types of support. Substantial participation of some of your 
most able and experienced people Is essential to the success of this 
project. Specific requests will be directed to you through my Deputy 
for Research and Technology. He, in turn, will be working closely will* 
your representative on the steering commit t ee, which has been monitoring 
and guiding the pilot programs, and which will continue in a similar 
role for the new project. 

Further details can be Ironed out at the Research and Engineering 
Policy Council meeting on July 12. However, if you disagree with this 
general approach, please notify me immediately. 1 see no other way of 
satisfying the Congress and the Secretary of Defense that wo are getting 
: ur money’s worth for RX1). Failure to satisfy these, questions will nl- • 
-io sl certainly have serious consequences to those Program Categories. 


Attachment: 

Outline of Plans for 
Project UrfWSlCHT 


/s/ HAKOId) DROWN 
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tffii'ti! ill I'ImH’. Htft I'l'Uli i ' Jillil’* li.i-.l . 

H.-.iMii i,' .tfiil i-i >irn=!. »■ | % '..lii'lt i:,r.' i-i-i-i. 
in Wi'j-iml! '.y-.lii'- 




I'.!.-.: li-.na .ij’l.iiii selects five members ol his i••;uri Vln> nr«- ti> U- 
.l.iii(/.lied luil-lii'ii' li> litis project lor ;i period of .-it It J months, 
feats merab. rs ,nv to he no I eel ed for their I eehnienl compel enrr as wcl 1 
.!•’ tin; i r special knowledge of tin- sysl ems bo I lip, studied. - Tlit* appoiiit- 
Ti'iil s'are made with tho support of the Asslslnnl Secretary (l<6l>) t>! the 
Military Depart menl with will'd) I ho team member h. assoc ialoil. . 


Nt”U_oniboi- 1 

Tho entire group moots for a 3-day pi anil I n p. session ill tin l'on lazuli. 
file.loam captains. the director, and the steering cotrnui tier will cost into 
to meet at regular Intervals throughout the study. 

Sepi ember J__- Nove mb er 1 

The studies of the first group of weapon systems are performed and 
eompleted. The objective is to identify and describe the RXD events, 
determine the place and time of origin, and certain other factors in¬ 
cluding selected aspects of the management environment in the originating 
organ Icat ion 

Noye_mbo_r_l_ - Janu ary 1 


Replacement teams of five members each are formed around a second 
set of systems. The captains of the new teams will cither be former 
ti.i*.. captains t bo recruited from former team members. A second group 
el • v.-ipmi systems are studied. 



i p: i- ■ *ii *i.t leal.,.- arc formed around a third group of system::. 


137 










Al'l’l N;i!/ 



iM in 1t tun hi .1 hVv.iVTii nr .1 l.ii-i .1 1 m / lii-vi Ii.pim-ii! I vi-iii 


■I Au.iii-,1 l'lf. 1 . 



which tin- id.o.l l>; ■•x.iiiii itcil hi tcsti-il. Tin- l.'XIl Event ilillil:. 11 • • 

v i so ;; ini j t ai Imm.m ■•ntlc.ivi>r. 1 i solely in I li.it the I in;-, m «-x.u:t i i>. 1 1 
is pi itn.ir i ly sc icut i I ic nr t••t'lmnIi>-;iI- exploration. 


Within tills del intiinn l lip pe t ind pi nil i vi l v - .ind, l Inis, Ui.- 
Event -is typical IvHf a ri’l.il ively slmrt dural ion, Irmii :i t.-w Wo.-h. to 
,t lew months. I'nr example: At some t inn* in the past, tin; idea on u r j >-d 
to .in individual or work group I li.it a livdrmlyivniiiiral ly general .-d ga:. 
journal hoaritip, for a gyrnseope rotor eould enable/improved gyroscope 
charnel oris! its over i»l iter rotor bearings currently aval 1 ah 1 The 
aotiyity of lilt orosl, or Event, would consist only of so much as-in¬ 
volved either a (lioorotiral oxamln.it ion of the’ influence of bearing 
y;ooinotry on static ami dynamic load-carryhi); capacity or a simple demon¬ 
stration that a rotor 1 ike, mass could he'suppni led on a hydrodyiiamirally 
generated gas hear ing journal. In other words, only the initial inves- 
t i gat ion adequate to demonstrate technical feasibility of the fundamen¬ 
tal idea is Included. It is important to note that titis Event does not 
extend to a prototype gyro development. 

Spec ta 1 Cons I derations 

. For purposes of the Department of Defense study of RXI) effective- • 
ness, those Events that contributed to developing a' weapon or other 
military system or a military capability are of primary interust. A 
noncontributing Event might be of interest if the idea has been tested 
and is recognized as continuing to be of a Itigli potential value but, for 
some technical reason, has not yet been exploited. 

Finally, the matter of Idea novelty warrants clarification. : The 
RXI) effectiveness study is addressed to the ascertaining of environ¬ 
mental factors associated with tlie successful prosecution and util iguiiot 
of results of RXI). It can be safely assumed that a given idea would get 
tlu< same treatment whether or not it was, in fact novel—as long as the 
coworkers and supervisors of the innovator thought it to be novel. The 
cril or ion for novelLy, then, is solely the contemporary opinion of the 
immediate sponsors of the idea. 

In terfa ce Activity 

Based on the above do f in it Lon of an RXI) Event, the history of the 
development, of a new device or component can be expected to contain a 







Trior to the occurrence of the lilea (sit.-!) or liush of iur.piral 
llu' innovator was Involved in llu* ;u«|uisit ion of knowledi'i-, through 
schooling of experience, . tliai coiiirliiental ly was prrtim-ut to tin- i «li 
Each oI the minor excursions to llw lrft. ol' I i nil f rat vs the'ai-qui si t 
of a bit of knowledge. These bits consist ui .U-flmiral know-how, op- 
at inn environmental far tors.ami* perhaps, operat ional requirements. 

I, some triggering element enabled this culminating of all of t ho pri¬ 
ce J outs into the idee. Siil)»o«|iu*ntly, tlio idea lft shown to bo uinler j 
live investigation. 

Continuing wltlt tin; generalization, assume that the output of tl 
above Event is in some manner related to another innovator. If the 
latter Individual makes use of the in Forma l ton tn the developing >r 
another idea, the information concerning the first Event becomes one 
the minor excursions in the latter's knowledge-accrual diagram, as ii 
Figure 2. 


Figure 2 











Preceding Page Blank 


AITI i.'i 1 ! 1 

KaD ! yciil ri|>t inn 


rt descript ive illlo idpul i Tv inj*. I lit* activity fc.g,, develop 
list rat ion, invest iit.it ion, study, cl c.) which ciilmiu.iteiliii 
ill;.; el phenomena, demons! rat ion of p cine ip lot, or spec i it < 
of principles (c.r., technique, device, mat erial, etc.). 

An RXI) Kvciil is roue.eived here as correspondin" to a period 
:tl activity with a we 11-do fined end poin t (c,j>., the preparu- 
report, presentation of a technical paper at a professjonaJ 
ding, patent disclosure, demonstration of fists ilii lit y of an 
themntic.il analysis or breadboard or brassboard modei , etc.), 
n creative or Innovative aet is Involved. One should be 
void (a) inclusion of normal engineering activity within the 
ry state of the art, (b) lumping a number of KXI) I.vents into 
ined class of such activity, and (c) confusing manufactured 
1th RXD Events.] 

it System 

Including the standard nomenclature and the common name if 
easy identification. 

stem 


Mice to an analysis of the weapon system into immediate and 
identifiable constituents, arbitrarily adopted as standard 
rs of this study. 

: For this purpose, overall System Concept, Aerodynamic 
ion, etc.,, will be treated as subsystems where considered 


cnee to an analysis of the subsystem into immediate anti 
i dent Ifiable components, considered as involving' RXD Events. 

: For this purpose, the Subsystem iXuicepl, or tlu* subsystem 
defined above, will be treated as an element where eonsid- 
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I*, .ryju' »i kxi* r.vtMii 

A •diort stati'Mciit >■ I.iti.lviii)'. the ■iv , i>' , i:ir• union■ ul I !n. I .vonI , 
so i out il ir iv::raivli, exploratory mal or In Is dove lopinonl , maim la. lm in)! 
process >|evo lopinonl . pal i'll toil iiivi'i'tloii resiil t inp. limn . i.o in, , i 

iiie., i'U - . (Tho purpose of tliis stalomcnl is In In. 1 ;i-;a;11 irat i. a 

of rxio 

i. Ko^jyysoiuioj^ 

•Tin' names of I he'individuals. havin'. sslKiiiriraiit rolvs In tin- RXli 
Kvont., wi th a brief (loseript l*.iu of oneli' one's ro.l t;, background aiu! expe¬ 
rience. (Kyerv reasonable attempt. should be mailt: to gel copies of t In- 
po r.soini 1 biography (rdsunK*) of the. individuals iilonti f icd.is having made 
a direct contribution Co tin* RXD Kvent. lliose resuini\; should be nppvndci 

to lho Kvont Description form.) Tlu* key personnel may ho trinpjoyed in 
tin- organ!sat I on whore the RX1) was performed, in a government project 
off Loo or laboratory, or elsewhere.. 

1!. Ditto of Kvont 

The year iu which the specific RXD Kvont activity terminated (see 
1 abovv). A more, detailed specification of the date should lie included 
when available. A starting date (approximate or estimated if necessary), 
consistent with die interface activity procedliip the RXD Kvcnf described 
in 13 below, should lie indicated. These initial and final dales should 
also be consistent with the financial di-a-riptions of item 12. 


9. . IHtrat ion 

The approximate length(s) ni t ime covered by lhe spec if ir , ticlini cal 
activity having tlif termination in 8 above. 
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I. A :•!'!* i i |H i«*i> nl.lli*- m .*.ir i.- ii , it- li»!iiv .»1-.- it r.i 

; .! ti unship.. ,inii'iH‘, I* ami «- .mii/.u ,ti-, ,|t- i ■ I » .. ,,j. . 

•yip I• * vl.u ilv l lio'ii.il m o »»i I In-m. .mi.-.ii i.s,. 


.111 imwiaiil |>arl in lKSII Kv. 11 1 .in.lidit.nl.I .ilia. I..- ideiil il ied where 
Appr.ip ri.it | 

It., oru.ini.inl ion Type 

Tlu* generic types of organizat ion corresponding to It) above. Till si 
should contain sufficient descripttve material to c larify fully the 
types of organization and organizational subdivision in question, c, g., 
industrial (prolit.)—corporate—research laboratory, industrial (profit) 
—doeratiug JtvisIon-—design engineering organization, university- 
operated Department of Defense research laboratory, etc. The purpose of 
tills paragraph (see''also h above) is to assist in tlm classification of 
organization types. 

id. Financial Support • 

Specific information on: 

a. The source(s) of funds. This should include information con¬ 
cerning both the internal accounting' treatment of the funds used and the 
ultimate sources of funds. Where the work is sponsored by the govern¬ 
ment or other sources external to the organization (10 above), specific, 
contract or subcontract numbers should be Identified where possible. 
Where the decision is made by the organization (10 above) to initiate 
the activity represented by the RXD Event, the way in which the costs 
are recovered or treated should be clarified (e.g., the expression 
"<oi;.,*any funds' snould refer only to the nonrecovered expenditure of a 
comp..-*y‘s earned surplus; where subsequent recovery in the sale of 
prode-tr or in negotiated overhead on government contracts is involved, 

h. The time duration of each source of funds. 
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. . lilt- 1 .'I .1 1 . .-'.I .HI I . T. I ■ Hi) I II ) 1 I.’ *-.'ll’li -...Mill- .'I I : I .. I • 
mm.-c -.uppm I km: e 111 .iii I In- ItNIi Ia’i-iiI- in ‘|iii .1 ieii, v l V. .ij 
il in-.' i-.-isai V , Hi fin- . |*.* i ■ i i'll .It I I 11 >111 .ih I ■ •' In 111.- K’.-nl . hi 

nl wil lilu- i.l. 

.!. Wlit-iv .Iilililli-Il.il liiiulill)'. was li'ipii II'.I in null I t •• In in;- I In- 
ivsiills nl llii- KXI> Kvi-nl .In a lull v n-n-lul jm i n ( willnml >.t in-t in'-i 
wiiing events,' ilu- Inl.il i-'ii.-il sh.-iiflil In- shown lii’ii-. A-11i ln.’il i vr! v, il 
llii- KM) Kvoiil in-i-urii’il during the emu si’ i:I a l.ilmi fitniv snt.lui m'-il pni 
j’.r.i’.ii in a l erlumlogy., .i iini ( -.l> idea a.-: to flu- lnl.il .iiiiiii.il prugiiiiii j.i:’i- 
should Im mi I ••i-i’il; iTlil.’i general Iv does uni applv In I In- i-asi- u. .-in lO.D 
Event 's oeeuri inj’. as pari nl a wi'.-ipnn-iiysl chi d.i-vi-f-opnn-lit project ’lu-ii- 
l hr I’i’i’iil v.is funded as pari nl l Im prujeel ; ami no entry is ri’iju i i«-d in. 
I lif« paragraph .1 

iNoii’: l ins I informal Inn should Im given in terms 61 Lot .iJ (i. , 

lullv burdened) nisi and surli rut i mat ns slinulil In- formed, where possible, 

. i I' tlm account in); prai-l ii-i’ of llieperlormiiig organizal ion ali ft'crs in 
tills respect .] 

13. S>^fi’in Interface Acti vity 

, a. In format Ion concerning the way in which the. RXD Event was uti¬ 
lized, that Ls, the steps by which It Was incorporated either in subse¬ 
quent, related RXI) Events or systems or in 2, ') or A above. Wherever 
possible, specifie events should be; identified, e .g., the-'preparation of 
a proposal, etc. . 

' b. Information concerning prior RXD.Events, system activity'or 
incidents'which contributed to, Influenced, or provided a motivation for, 
the RXt) in question. In' particular, where government sponsorship of the 
KXD work is involved, state whether the.. technical initiative resided in 
the performing organization, the government, or elsewhere. 

14. RXD Event Circumstances 

Miscellaneous information relating to the RXD Event but not else¬ 
where classified. Management environmental information may be recorded 
here. Wherever, because of the nature of the RXD Event, it is possible 
to demonstrate a relationship between the cost 01 the RXD Event and the 
cost sayings to the government of either the final weapon systems or 
specific ’delivered hardware, this informal loti should be identified and 
reported here. 

15. Sources’ 

Documents, persons interviewed, etc. 

Author: Telephone number': 

Date of preparation: 

Attachment: Example of RXD Event Description 
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At ( dt inn 'til i n i - t 

KXH Iv.-rit l)i>Mri|Hi.)ii 


I In* i Shi I I l.\ *i'.i 



IVrlmuMl Sh-nil i.-aiuo: 


.». Origin, Tivluiiriil Ac I i v i I v alid iHitcorae: 

This event is (lie coin-ept ion and demonstration ol determining 
the t*r|>U of a near-earth satellite oil a slue.Jr pass l»v an accurate 
measurement i»r tlu> Uoppler shift pattern in llu* radio iglia 1 s traus-. 
mitt oil bv tlu» ssatril Sir. Hit* floppier effect is an apparent change in 
frequency caused l>y thr relative notion between transmitter and receiver. 

b. Relationship to Contemporary Srlemit* and Technology:.... 

At Llu* time, of tills event there were ..ryeral metliods of trackiup 
sate!ilies. Opt leal tracking instruments using the visible-light port ion 
of the electromagnetie spectrum, sucli as the Buke.r-Nunn ballistic camera 
wlileli determines angular position by photographing the vehicle against a 
star background, are highly accurate. However, tlieir capability is lim¬ 
ited by darkness, clouds and haze. Also, the data require specialized 
handling,: sometimes deLaying the output beyond the period of usefulness. 

Infrared radiation from the satellite permits it to be tracked 
through some haze .conditions, but infrared is absorbed by the lower at¬ 
mosphere, limiting its detection In ground stations. 

Radio tracking techniques included radar scanning for the di¬ 
rection of the strongest signal and interferometer comparison of signal 
phases received by separate antennas. Minitrack, which operates from 
the. laLter principle, depends on a transmitted frequency to establish 
the line of position between the satellite and ilia tracking station. 

Wlille Minitrack uses a small part of the Doppler shift te meas¬ 
ure miss distances and cannot determine the orbit in a single pass, tin's 
even! derives all six orbit parameters from the total Doppler shift in 
one pass. Using scalar as opposed to vector measurements allowed vast 
simplifloat ions while retaining accuracy. For example, only small an¬ 
tennas with a minimum exposure were required. Bumblebee Series Report 
No, 27ft was issued April 1958 and distributed to anyone interested in 
satellite tracking. 

1*>7 






•I)r. Will i. im iIiiut, fln-mvl icnl Plivs i .• isl , Kiscal.h C.-nt .1 . Coi. 
reived I In* event willi We i I'l cuhach. His I lair with ciiinjiul < • 1 ■. wa:. a yi.-at 
aiil mi redin'iny. 1 In* Hopplei sliil l iii iliv.il.il lonu In «l*-v»-1 «>ij. al'inn 

.il t erhnitpu-s for e.st rnel iny, otIm t u t d.il a. 

Dr. George Wei f I'onhueh, Thenivi leal I'liyr.i hu , Hosc.-ircli <: v nl rr. 
Cotii’i’i vial -l lu* event a ml was .ju'iiiiaTl Iv fcspiiusihlc lur 1 lie arrurai «• 
measurement of the Doppler shift. 

Henry Riblet, Supervisor, HID Croup, Kxperi cnee in missile telem¬ 
etry eenlrtbulod to his sol liny, up elect runic equipment for the arquisj- 
l ion of experimental Jala. 

I)r. Rr R, Newton, 'Ll 100 rot leal -Physic Lsif, lli'search Center. Assistoi! 
in theoretical analysis from Lite standpoint of celestial mechanics. 

Also assistoJ in programming; 

8. Date, of liven t .* 

a. Termination: April 1958 
l). Initiation: October 1957 

9. Duration : Six months 
LO. Organisation : 

a. Jolms Hopkins University 

b. Applied Physics Laboratory 

c. Research Center 

d. The Research Center participated in many phases of .basic 
unapplied investigation. 

11. Organiz a tion Type : Government laboratory 

12. Financial Su p port : 

a. Source: in-house Task 1) (11-54) - funds for basic research 
h. Duration:' Six months 
c. Amount: list ini.n Led $14,000 







ipitluik ::igunI which was in .111 overcrowded region ol I In- Kl sport m:: 
In. UXP Kyonl O i iy iiins I nines: 


Ur. I'r.ink McClure, Oha (rout it ol' tin- Riwarrh Coni or, was skeptical 
• I tIn' possibility of accurately tracking a satcl I ill* wi th tin- Doppler 
technique; however, ho support oil a serious continuation of tin* initial 
invert i}«,it ion alt hough no practical application was in sight at this 
11 mo. Originally the orbital paramo tors were worked out. with a slide 
rule, lull AIM. forluilouslv acquired a lliiivac 1101 which permi tted mue.l 
(ufeker, more accurate computations. Because the machine was new and 
priori ties had not been established, the computer was available day ai 
night. C. V. Hit ter I i, wlu> worked with the computer, became very inti 
l*s ted in the Doppler theory and creatively experimented with computer 
input and calculations. After two months of study, the Doppler curve 
looked more and more sensitive and unique, and its reliability in pre¬ 
dicting orbit was much greater than anticipated. Eventually, good laj 
recorders and sophisticated radio tracking equipment were acquired to 
validate the Doppler method. 

Important to the snv.eess of this event were the freedom allowed 
iln lor and Wei ffenhach and the acquisition of the Untvae. 1103 at a eril 
cal lime. The enthusiasm generated liy the key participants led many 
individuals to work on their own time. In early 1958 a geodesist frot 
1 tie Anns’ Map Service, O'Keefe, somehow found out about the Doppler le- 












APPENDIX I) 


Summary of RX_D Events 


Note: Numbers omit Led 
from the consecutive 
scries represent reports 
withdrawn from the study. 
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Use with a Clutter Rejec- 
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Control (TVC) by Mechanical Spoilers (Jetavatorsl 
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APPENDIX I. 

DoD Funding for RDT&E and Estim ated R_Xp _Lxpendi_tureji 


The following table shown total -DoD funding for ROT&K from 1947 
through 1%'J. The estimated RK1) expenditures are based on the assump¬ 
tion that about 20 to 25 percent of the RDT&E funds was spent on research 
in science and technology. 


Year 

Total RDT&E Funding 
($ millions) 

Estimated RXD Expenditures 
($ millions) 

1947 

515 

.118 

1948 

534 

123 

1949 

608 

140 

1950 

539 

124 

1951 

758 

174 

1952 

1,164 

268 

1953 

2,150 

495 

1954 

2,187 

505 

1955 

2,261 

520 

1956 

2,101 

485 

1957 

2,406 

555 

1958 

2,504 

575 

1959 

2,860 

660 

1960 

4,710 

1,080 

1961 

6,131 

1,410 

1962 

7,643 

1,308 

1963 

7,638 

46,709 

1,445 

9,995 
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